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I. INTRODUCTION AND BACKGROUND 


A. INTRODUCTION 

On September 20, 2001, the Quadrennial Defense Review (QDR) direeted the 
applieation of Performanee-Based Logisties (PBL) to new and legaey weapon systems. 
PBL implementation is mandated by Department of Defense (DoD) Direetive 5000.1 
(El. 17 direets Program Managers (PMs) to develop and implement PBL strategies that 
optimize total system availability while minimizing eost and the logisties footprint) 
(DODD 5000.1, 2003). PBL is a move from eontraeting for material performanee and 
availability, to eontraeting for weapon system availability. Instead of buying set levels of 
spares, repairs, tools, and data, the new foeus is on buying a predetermined level of 
performanee to meet the war-fighters objeetives. 

In aeeordanee with DoD Direetives, the Tank, Automotive and Armaments 
Command (TACOM) offered the Standard Automotive Tool Set (SATS) along with 
several other systems as potential eandidates for PBL strategy implementation in early 
2004. With only minimal proeedural guidanee, TACOM has been struggling through the 
PBL proeess. These struggles prompted a further investigation into PBL and the 
organizations that have implemented PBL. Thus began the seareh for best praetiees and 
lessons learned regarding PBL implementation. 

This researeh investigates four programs that have a fully implemented PBL 
proeess in plaee. PBL is so diverse and is faeed with so many ehallenges, that it would 
be impossible to eomplete a eomprehensive study of PBL Programs. This researeh is 
therefore limited to one partieular aspeet of PBL, the implieations of organizational 
design on the implementation of PBL programs. 

B, PREMISE 

Implementation of PBL involves a transformational ehange from a transaetion- 
based approaeh to a performanee-based approaeh. Beeause one of the biggest barriers to 
ehange involves the design faetors of an organization, we deeided to foeus our efforts in 
that area. 
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C. PROBLEM STATEMENT 

Systems Hypothesis: The fit or congruence of organizational design factors 
shapes the organizational culture, which directly impacts performance (outputs and 
outcomes) (Nadler & Tushman, 1980). 

D, BACKGROUND 

1, What is Performance-Based Logistics (PBL)? 

PBL is covered in greater detail in Chapter II, however, a brief description is 
provided to set the stage for understanding the overall topic. 

As defined in a Roadshow Briefing prepared by the Office of the Deputy 
Assistant Secretary of the Army for Integrated Logistics Support (ILS), PBL is “a 
strategy for weapon system product support that employs the purchase of support as an 
integrated performance package designed to optimize system readiness. It meets 
performance goals for a weapon system through a support structure based on 
performance agreements with clear lines of authority and responsibility.” (DAU TACOM 
PBL Roadshow, 2004). (Product support is defined as a package of logistics support 
functions necessary to maintain the readiness and operational capability of a system or 
subsystem. The package of logistics support functions includes material management, 
distribution, technical data management, maintenance, training, configuration 
management, engineering support, repair parts management, failure reporting and 
analysis, and reliability growth (PBL, March 2005). More simply, PBL is about buying a 
solution or outcome, not defining the process or method to achieve it. It is about 
assigning responsibility to the supplier, not the requiring organization. Instead of the 
traditional role of managing supplies, the government’s role in PBL becomes one of 
managing the supplier where the supplier has a more active role. 

According to a memorandum addressed to the Assistant Secretaries of the 
Military Departments and signed November 10, 2004 by the Acting Under Secretary of 
Defense, Michael Wynne, PBL is the Department of Defense (DoD) strategy to improve 
weapon system readiness and support. Wynne’s memorandum claims that PBL 
initiatives implemented within the last three years continues to generate significant cost 
savings and improved capabilities. 
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2, How Does PEL Work? 

PBL is a business practice in which the government contracts for performance 
that is designed to meet the war-fighter’s operational needs. Support objectives are 
matched with required performance outcomes and available resources. Although PBL 
contracts may have the tone of service contracts, they are really hybrids of service and 
supply, which, in concept, encourage the contractor to achieve a high level of 
performance at a fixed cost. New programs or systems will use PBL to develop, refine, 
and implement a performance-based strategy during the systems acquisition process. 
Legacy or fielded systems will be assessed for performance and support alternatives. The 
establishment of effective business relationships is important to the success of PBL 
Programs. 

The application of PBL will differ from program to program, or system to system, 
because each has unique aspects. PBL strategies for a specific program or system must 
be tailored to the operational and support requirements of that system. Almost all of 
DoD’s system support is comprised of a combination of organic and commercial support 
sources, but the mix of support services differs based on the end item. The spectrum can 
range from organic support, to total system support provided by an Original Equipment 
Manufacturer (OEM.) 

Although PBE is a relatively new term, its theoretical foundations were formed in 
the 1980s when increased emphasis on quality came into focus. Mechanisms such as 
Statistical Process Control, Total Quality Management, and International Organization 
for Standardization (ISO) certifications introduced scientific methods for obtaining 
quality control. DoD and industry continually search for the best methods to use scarce 
resources, including capitalizing on core competencies, outsourcing functions that did not 
add value, and infusing new technology and innovation. The idea of redesigning 
government systems acquisition started with the need to form external business 
relationships and partnerships to share resources and work toward common goals. This 
mindset has brought about implementation of concepts such as Contractor Logistics 
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Support (CLS), Public-Private Partnerships, Direet Vendor Delivery, Supply Chain 
Management, and more reeently PBL and Full Service Contractor (FSC) Business 
Models. 

These eoneepts can be complex. Both supporting and opposing opinion for PBL 
ean be found. The overarching purpose of this study is to advance the understanding of 
PBL and the effects of organizational design factors on the implementation of this 
business practice. Knowing that each organization has overcome unique barriers, and 
that defining clear logistics performance criteria is difficult, the study examines and 
compares variables from four Navy PBL program offiees. 

Meehanistic or bureaueratic organizations are eomplex due to an inereasingly 
diverse workforee consisting of different pereeptions, ideas, interests, skills, education 
levels, genders, and cultures. 

Based on studies through the Naval Postgraduate Sehool (NPS) along with real 
life experienees, characteristics of organizational design have been identified that directly 
influence systems proeesses, aequisition strategies, and overall success factors. These 
lessons and experiences have been used to help analyze both the organizational design 
and results of four, fully implemented Navy PBL Programs. 

The Organizational Systems Framework is a theoretieal construct used to describe 
organizations in terms of inputs, throughputs, and results. Design factors (throughputs) 
include tasks/jobs, technology, structure, people, and process/subsystems (Roberts, 
2000). Using the Organizational Systems Framework as a theoretieal foundation, this 
study analyzes the design factors of four organizations to evaluate how key faetors have 
influenced PBL implementation. Once identified, predicted areas of strengths and areas 
for possible improvements ean be applied to the TACOM SALS Program. 

E, SCOPE 

Because the topic of PBL is relatively broad and complex, this study focuses 
primarily on the organizational design factors of four program offices that have 
implemented PBL programs. Limited ease study with some baekground detail is 
provided to elarify how the programs were setup and what types of weapon systems are 
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using PBL. Emphasis of the research rests on the results of interviews with team 
members that worked PBL programs. Systems theory is used to group data and to 
determine the extent to which design factors may have contributed to higher or lower 
levels of performance, i.e., extent of congruence. 

F, PURPOSE OF THE STUDY 

The purpose of this study is to describe and analyze the organizational design 
factors that may benefit or hinder PBL implementation. This paper focuses on the 
specific areas and design factors of structure, processes, and people. Using information 
obtained from semi-structured interviews with PBL Integrated Product Team (IPT) 
members, the study identified additional organizational characteristics that appeared to 
affect PBL implementation in the four Navy programs. Those characteristics were then 
applied to the TACOM SATS Program to generate recommendations and facilitate 
implementation. Simply stated, analysis shows whether the organizational design of the 
SATS team appears more or less conducive to a smooth transition into PBL. Based on 
this analysis, a template has been formed that may be applied to other TACOM programs. 
The template allows users to identify organizational design factors that facilitate the use 
of PBL. Review and analysis of the information collected is intended to advance the 
understanding of PBL and the effects of organizational design factors on the 
implementation of this business practice. 

G. RESEARCH QUESTIONS 

The research questions have been structured to help formulate an understanding 
of how PBL might fit within the Army and specifically, TACOM. By investigating 
experiences and applying lessons learned from fully implemented PBL Programs, the 
chances for success within the Army will increase. The three research questions 
addressed in this project are as follows: 

Question 1: What are the organizational design lessons learned from 

implementation of four PBL programs, and how can lessons be used to assist leaders and 
managers in implementing PBL into their programs? 

Question 2: What configuration of organizational design elements appear to have 
positive or negative impacts on implementing TACOM’s PBL initiatives? 
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Question 3: What is the template (identifying organizational design 

eharaeteristies) needed for sueeessful PBL implementation in TACOM? 

H. IMPORTANCE OF THE STUDY 

The eoneept of PBL is modern; however, reeent GAO reports suggest that PBL 
may not be appropriate for applieation to all programs or systems. (GAO, August 2004) 
Beeause of the eomplexities assoeiated with implementation, GAO eontends that PBL 
should only be eonsidered in eertain eireumstanees, and DoD Direetives and guidanee 
should reflect the appropriate criteria for use. 

This study is important in order to identify organizational design factors 
considered to be critical for successful implementation of PBL. The research shows that 
organization design plays a big role in the way concepts such as PBL are received and 
executed by leadership and subordinates. Since PBL is mandated by DoD Directive 
5000.1, it is time for the Army to move beyond concept and into implementation. This 
project offers insight to make the transition of managing for performance more effective. 
Research supports the theory that the success of attributes leading to full implementation 
depends on the design factors of the organization and how the organization reacts to 
change. 

I. ASSUMPTIONS 

(1) PBL is being implemented across all the Services and the Army is being 
directed to embrace it and move forward. It is not a viable option to ignore PBL. 

(2) Although the term PBL is not widely used in the private sector, it appears to 
have general recognition. For over a decade, the private sector has implemented Supply 
Chain Management, which contains many of the same characteristics as PBL. 

(3) New environments, business practices, and transformation practices face 
resistance. The change from traditional logistics to performance-based logistics will 
continue to encounter resistance. 

J. LIMITATIONS 

This study describes and analyzes organizational design factors that may play a 
substantial role in successful implementation of PBL. Although PBL is used by all the 
Services, this research focuses on four Navy programs; the F/A-18 E/F Integrated 
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Readiness Support Teaming (FIRST), the AN/ALR-67(v)3 Radar Warning Receivers, the 
Auxiliary Power Units (APUs), and the F404 Engines. This paper focuses on three of the 
five design factors that makeup the Organizational Systems Framework, specifically the 
areas of structure, processes, and people. 

K. SUMMARY 

This chapter explains how PBL came about, outlines the background of PBL, 
defines the purpose of the study, identifies the scope of the project and the associated 
assumptions, and addresses the limitations. The purpose and importance should now be 
clear as we begin the literary review of the PBL process, DoD policy and guidance, the 
practice of supply chain management, and the Organizational Systems Framework. 
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II. LITERARY REVIEW 


A. INTRODUCTION 

This chapter contains a literary review of Performance-Based Logistics (PBL) and 
the Organization Systems Framework (Roberts, 2000). It defines PBL and the PBL 
implementation process. It also includes DoD policy and guidance, status of DoD 
implementation and current industry practices. The chapter concludes with a description 
of the Organizational Systems Framework and how it will be applied to data grouping 
and presentation. 

B, DESCRIPTION OF PERFORMANCE-BASED LOGISTICS 

PBL is a strategy for weapon system product support that employs the purchase of 
support as an integrated performance package designed to bring higher levels of system 
readiness. It describes performance goals for weapon system readiness and encourages 
the creation of incentives for attaining those goals through clear lines of authority and 
responsibility. PBL is a move from contracting for material availability, to contracting 
for weapon system capability and performance. Instead of buying set levels of spares, 
repairs, tools, and data, the new focus is on buying a predetermined level of capability to 
meet the war-fighters objectives. More simply put, PBL is about buying a solution or 
outcome and certain level of performance, not defining the process or method to achieve 
it (DAG, 2004). 

PBL utilizes a performance-based acquisition strategy that is developed, refined 
and implemented during the systems acquisition process for new programs, or as a result 
of an assessment of performance and support alternatives for fielded systems. The 
essence of PBL is buying performance through business relationships that are structured 
to meet the war-fighters operational needs and match support objectives with required 
performance outcomes and available resources. The idea is to buy long-term total system 
support for a weapon system at a fixed level of annual funding. In concept, performance- 
based contracts encourage the contractor to achieve a high level of performance at an 
affordable price. 
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The application of PBL will differ from program to program, or system to system, 
because each has unique characteristics that impact design and implementation strategies. 
PBL strategies for a specific program or system must be tailored to the operational and 
support requirements of that system. Almost all of DoD’s system support is comprised of 
a combination of organic and commercial support sources, but the mix of support 
services differ based on the end item. The spectrum can range from organic support, 
where the government performs all maintenance services and manages its own supply 
chain, to total system support provided by an Original Equipment Manufacturer (OEM), 
but there are many support strategies in-between. 


More Organic 



More Commercial 


Traditional 

Organic 

Support 

Environment 


Organic Support 


Contractor Support 




Contractor 
Responsible 
For Majority 
of Support 


Eigure 1. Organic and Commercial Support Sources (Erom; PBE, March 

2005) 

Eor example, the government could choose an inventory based support strategy, 
buying supplies itself (internally managing the supply chain) and contracting for 
maintenance services, or issue performance-based contracts allowing the supply chain to 
be managed by a contractor and have maintenance services performed organically. 
Whatever strategy is chosen, it seems that the use of PBE allows the government more 
opportunities to access commercial practices and technology for providing logistics 
support and allows industry more opportunity to apply innovative approaches to product 
development and support. 
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C. DOD POLICIES AND GUIDANCE 

The Quadrennial Defense Review (QDR, September 2001) mandated 
implementation of Performance-Based Logistics and modern business systems with 
appropriate metrics to compress the supply chain, eliminate non-value added steps and 
improve readiness for major weapons systems and commodities. Specifically, DoD’s 
strategic goals for acquisition logistics were to project and sustain the force with minimal 
footprint; reduce cycle times to industry standards; and implement Performance-Based 
Logistics (QDR, September 2001.) 

The Deputy Secretary of Defense issued “Implementation of the Defense 
Business Practice Implementation Board (DBB) Recommendation to the Senior 
Executive Council (SEC) on Continued Progress on Performance-Based Logistics” on 
Eebruary 4, 2004. The Defense Business Practice Implementation Board Supply Chain 
Support Task Group recommended a more aggressive approach to implementing PBL. 
The Deputy Secretary stated that a delay in implementing PBL complicates funding, 
limits industry flexibility, and increases DoD inventory. The Deputy Secretary further 
stated that DoD must streamline contracting and financing to buy availability and 
readiness measured by performance criteria. He directed the Under Secretary of Defense 
(USD), Acquisition, Technology, and Logistics (AT&L) to issue guidance on purchasing 
and using performance criteria. He directed the Military Departments to provide a plan 
in 120 days, to aggressively implement PBL, and to include the transfer of funding on 
current and planned systems for EYs 2006-2009 (DoDIG, August 2004). 

Performance-Based Eogistics (PBE) has been established by the Office of the 
Secretary of Defense as the new way to acquire and operate support for systems. As 
evidenced by the Directives noted above, it is the DoD preferred approach for improving 
war fighter capability, reducing deployment footprint and reducing cost of ownership. 
The Acting Under Secretary of Defense, Michael Wynne, confirmed this in a November 
10, 2004 memorandum addressed to the Assistant Secretaries of the Military Departments 
wherein he stated that PBL “is the Department of Defense (DoD) strategy to improve 
weapon system readiness and support.” (Under Secretary of Defense, November 2004) 
Claude M. Bolton Jr., Assistant Secretary of the Army endorsed the Army’s use of PBL 

11 



in a memorandum dated November 4, 2004 addressed to U.S. Army Commands and 
Program Exeeutive Offiees/Program Managers (PEOs/PMs). (DA, November 2004.) 

DoD Direetive 5000.1 and the Defense Aequisition Guidebook (DAG) instructs 
program managers to establish a Performance-Based Eogistics approach in fulfilling their 
product support, integrated supply chain management, and other Eife-Cycle Eogistics 
responsibilities. The Directive also states, “To maximize competition, innovation, and 
interoperability, and to enable greater flexibility in capitalizing on commercial 
technologies to reduce costs, acquisition managers shall consider and use performance- 
based strategies for acquiring and sustaining products and services whenever feasible. 
Eor products, this includes all new procurements and major modifications and upgrades, 
as well as reprocurements of systems, subsystems, and spares that are procured beyond 
the initial production contract award.” (DoDD 5000.1, Para El. 16.) The guide states that 
Performance-Based Logistics can help program managers optimize performance and cost 
objectives through the strategic implementation of varying degrees of Government- 
Industry partnerships. (DAG, Para 5.3, December 2004.) DoD 5000.2 instructs program 
managers to work with users to document performance and support requirements in 
performance agreements specifying objectives, outcomes, measures, resource 
commitments, and stakeholder responsibilities. (DoD 5000.2, Para 3.9.2.4.) 

The Directives, Guides, and memorandums from leaders are consistent and clear. 
DoD will adopt PBL as its primary support strategy. 

D. PBL PROCESS 

The Defense Acquisition Guidebook lays out a methodology for implementing 
PBL. There are twelve steps in the process. The following briefly summarizes this 
process. 

1. Integrate Requirements and Support 

Eirst, requirements and support must be integrated. Locus must be placed on 
linking supportability to overall performance. A clear definition of capability needs from 
the war fighter is required. A factual assessment of current performance in measurable 
terms is also required. War fighter needs are translated into performance and support 
metrics which, along with any constraints such as funding, are included in an agreement 
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between the Program Manager (PM) and the war tighter. This doeument is ealled a 
Performanee-Based Agreement (PBA). 

2. Establish Implementation Team 

Onee the PBA is eompleted, a PBL team should be established. This team 
develops and manages the implementation. The team should inelude applieable 
stakeholders (users or their representatives too), and is led by the PM as total life eyele 
systems manager. The strueture of the team may vary depending on the maturity and 
mission of the program, however it would be eommon for a PBL team to eross 
organization boundaries. 

3. Baseline the System 

After the team is established, they should baseline the weapon system. Base 
lining basieally eonsists of identifying key stakeholders, defining the seope of support 
required, and defining eost and performanee objeetives. If systems are fielded, historie 
readiness rates and operation/support eosts relative to the upgraded or new system are 
required. The differenee between the existing and desired performanee requirements 
must be examined. For new programs with no existing logisties strueture, the baseline 
should include an examination of the cost to support the replaced systems. If there is no 
replaced system, life cycle cost estimates should be used. For existing fielded systems, 
actual data for sustainment and readiness performance history, and associated operations 
and support cost is used. The baseline information should be formally documented, as it 
forms the basis for the business case analysis discussed in a future paragraph. 

4. Develop Performance Outcomes 

The PBL team focuses on a few outcomes, using corresponding metrics that link 
to the existing war fighters measures of performance and reporting systems. To be 
effective, PBL must have associated metrics that reflect the user’s needs and are an 
effective measure of the support provider’s performance. 

The top-level metric objectives for PBL are defined in USD (AT&L) 
memorandum dated August 2004, Performance-Based Logistics: Purchasing Using 
Performance-Based Criteria. They are as follows: 
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• Operational Availability - the pereent of time the system is available for 
mission. 

• Operational Reliability - pereent of objeetives met, by system. 

• Cost per Unit Usage - operational costs/unit of measurement (for example, 
flight hour, mile driven, etc.) 

• Logistics Footprint - “presence” of deployed logistics support (for 
example, inventory, equipment, personnel, transportation assets, etc.) 

• Logistics Response Time - the time from a demand signal to the time of 
satisfaction. (PBL, March 2005.) 

5. Select Product Support Integrator (PSI) 

Next, the team develops performance outcomes that focus on user needs - having 
a system that is operationally available, reliable, and effective, with a minimal logistics 
footprint and at a reasonable cost. At this point, the PM will select a Performance System 
Integrator or Product Support Integrator (PSI). The PSI is a single point of accountability 
for support and may be from the government or private sector. The PSI is assigned 
responsibility for integrating the efforts of industry and government support providers 
who are responsible for meeting performance objectives. They will coordinate the work 
and business relationships necessary to satisfy the performance-based agreements. 

6. Allocate Workload 

The next step is to develop the workload allocation strategy. According to DoD 
Directive 5000.1, EL 17, “sustainment strategies shall include the best use of public and 
private sector capabilities through govemment/industry partnering initiatives, in 
accordance with statutory requirements.” (DoD 5000.1, Para EL 17.) The PBL team 
addresses each discrete workload to assess where, and by whom it can be accomplished. 
The sourcing decisions must consider existing support processes and infrastructures, as 
well as evaluation of organic/private best capabilities. The support can be almost totally 
organic (a Memorandum of Agreement with an organic activity to procure, repair, stock 
and issue material), a mix of organic/commercial support, or nearly total commercial 
support. The determination of what the mix should be for any given product or service 
must also take into consideration public law restrictions on contracting-out some 
functions. Congress has enacted a number of statutes that restrict the Department’s 
actions using commercial sector maintenance capabilities. Eor example, 10 U.S.C. 2464 
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directs DoD to maintain a core logistics capability to perform maintenance and support of 
mission essential equipment. Section 2469 stipulates that existing depot-level 
maintenance or repair workload valued at $3 million or more must not be contracted out 
or moved to another depot-level activity without using A-76 procedures or DoD depot 
merit-based selection procedures. Public Law 105-261, section 346 of the National 
Defense Authorization Act for FY1999, as amended by Public Law 106-65, section 336 
of the National Defense Authorization Act for FY 2000, requires a report to Congress 
prior to the award of a prime vendor contract for depot level maintenance or repair of a 
weapon system. The report must contain a description of the competitive procedures 
used to award the contract and an analysis of costs/benefits demonstrating savings over 
the life of the contract. It must also include an analysis of the extent to which it complies 
with section 2466 and 2464 mentioned above. 

7, Supply Chain Strategy 

Next, the team develops the supply chain management strategy (material support), 
which is a critical step in the implementation process. Supply chain management refers 
to all of the inter-related components and processes needed to get the correct product in 
the correct location at the right time. (GAO 04-715, August 2004.) Supply chain 
management includes distribution, asset visibility, and obsolescence mitigation of spare 
parts. The supply chain is a key area for utilizing industry flexibility, capability, and 
proprietary spares support. 

8, Establish Performance-Based Agreements 

A Performance-Based Agreement is a document that formalizes performance and 
support requirements, objective outcomes, measures, resource commitments, and 
stakeholder responsibilities. The implementation team prepares this document to create a 
clear understanding of the outcomes and commitments required to achieve the outcomes 
amongst the stakeholders. 

9, Business Case Analysis (BCA) 

When the strategies have been completed, the team conducts a business case 
analysis (BCA). The BCA is a cost/benefit analysis to determine an optimal solution. 
The BCA serves as a formal record of the evaluation of alternatives and the basis of 

recommended solutions. This analysis is used during the initial decision making process 
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to select among alternative approaches and to determine whether or not to invest in a 
project. It is also later used to validate proposed scope, schedule, or budget changes 
during the course of the project. 

10. Contract Execution 

Finally, PBL contracts (or Memorandums of Agreement for organic support) 
should be executed. During this step, commercial PBL suppliers may take on a number 
of functions normally or previously performed by various DoD services or agencies. 
These functions may include spare parts requirements determination, physical 
distribution, warehousing of material, depot level maintenance, and some engineering 
functions. 

DoD encourages teams implementing PBL to utilize Federal Acquisition 
Regulation (FAR) Part 12 for Commercial Item Acquisition. The preference is to use 
long-term contracts with Statements of Objectives and incentives tied to performance. 
Ideally, those contracts would be fixed price, however DoD recognizes that fixed price 
contracts may increase risk early in the product life cycle when baseline data may not be 
available. (PBL, March 2005.) Fixed price contracts may also limit the government’s 
flexibility in mission execution as it makes revision to support strategies more difficult, 
especially in times of military surge. Military services require flexible business 
relationships because requirements change with time, missions, and world conditions. 

The most recent Product Support Guide recommends that PBL contracts contain 
an exit strategy or criteria to be used at the completion of the contract, or in case the 
contractor is unable to perform. (PBL, March 2005.) 

11. Employ Financial Enablers 

When executing PBAs, the Program Manager must implement an enabling 
financial process. Acquisition of performance is facilitated by single line items and a 
single type of money. The customer advocates for the required funding. Once the funds 
have been appropriated, the customer has the responsibility to ensure that the funds are 
available for the support defined in the PBA, while the PM is responsible for fund 
management and oversight. 
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12. Post Award Responsibility - Assessment 

After award, the PM has an oversight role of monitoring and assessing 
performanee against the PBA. (Reeall that the PBA is the agreement between the war 
fighter/user and the PM based on eapability needs.) A key eomponent of PBL 
implementation is metries. Sinee PBL is basieally the purehase of performanee, sueh 
performanee must be traeked, measured, and assessed. 

E, STATUS OF DOD-WIDE IMPLEMENTATION 

On August 23, 2004, the DoD Inspeetor General (DODIG, August 2004) issued 
report #D-2004-110 whieh doeumented the status of PBL implementation for U.S. 
military serviees. The report stated that “with the exeeption of the Navy, their (services) 
efforts were inconsistent, processes were inadequate and uncoordinated, and the results 
were undeterminable.” (DODIG, August 2004.) 

At the direction of the Assistant Secretary of the Army for Acquisition, Logistics 
and Technology, the Army had initially identified 77 systems, subsystems or components 
as candidates for PBL implementation. The IG found that some of the 77 systems had 
partnering agreements or Contractor Logistics Support (CLS) in place before the 
direction to implement PBL and questioned whether those programs should be included 
in the implementation metrics at all. Many had not implemented PBL as a result of a 
Business Case Analysis (BCA), nor did they contain performance goals and incentives. 
This reporting discrepancy had little bearing on report metrics, however. The actual 
number of programs for which PBL was implemented could not accurately be determined 
because the Army lacked a consistent method to determine candidates and then later 
report on implementation. 

The Air Force did not track or even request PBL implementation status 
information. They could not identify how many programs had implemented a PBL 
strategy. 

Of the three services, the Navy had the most information available and appeared 
to be the most aggressive in use of PBL strategies. They had issued more than 140 PBL 
contracts and agreements as of March 2004 and had another 47 in process. (DODIG, 
August 2004.) (Like the Army, the Navy information contained programs that had 
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implemented PBL before direeted to do so, and thus may not have been the result of a 
business case analysis or contained performance goals and incentives.) The Navy data 
system identified the level at which an individual program had implemented PBL and 
further identified the status by subsystem and single components. 

In total, military departments provided data showing PBL implementation for 257 
systems, subsystems, or components, however that number included systems initiated 
before the PBL requirement that might not contain PBL performance goal strategies. The 
IG report thereby concluded that the number of 257 might be highly overstated. 
(DODIG, August 2004.) 

The DODIG attributed poor progression of implementation to several factors. A 
primary factor was that DoD had not issued adequate PBL implementation guidance or 
established sufficient oversight. The Military Departments did not establish training 
requirements for executing PBL initiatives, thus it seemed that PBL participants did not 
have a clear understanding of their roles, responsibilities, and implementation procedures, 
clearly a barrier to successful implementation. 

The secondary reason sited by DODIG was that the services lacked a standardized 
data collection system for tracking and reporting implementation status. The Army and 
Navy had established their own data collection system but they were inconsistent and 
generally not adequate. The Air Force had no data collection system at all and thus had 
no way to measure progress of PBL implementation. 

The IG recommended that the Assistant Deputy Under Secretary of Defense 
(Logistics Plans and Programs), as the office responsible for overseeing the 
implementation of PBL, finalize written guidance to define PBL terminology and define 
responsibilities for implementation. They also recommended the same office establish 
written guidance to better define the process and procedures to develop the BCA (to aid 
in determination of potential PBL candidates) and to establish a standardized data 
collection system along with regular reporting requirements. 

The recommendations resulted in additional guidance in the Defense Acquisition 
Guidebook (December 2004), as well as an update to the Product Support Guide (March 
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2005.) Updated information concerning data collection, reporting requirements, and 
oversight was not available at the time of this writing. 

F, SUPPLY CHAIN MANAGEMENT 

Although PBL seems to be a DoD term, utilization of PBL strategies is not 
limited to DoD. The commercial sector also utilizes PBL strategies, sometimes using the 
term supply chain management. Recall that supply chain management refers to all of the 
inter-related components and processes required to ensure that the correct amount of 
product is in the correct location at the right time. (GAO 04-715, August 2004.) 

In an effort to enhance military opportunities to implement PBL, GAO conducted 
a study in 2004 to determine if DoD policy was consistent with industry best practices. 
They interviewed 14 private companies that used complex and costly equipment with 
life-cycle management issues. Those companies were determined to be the most likely to 
face support issues and decisions similar to those faced by DoD for military systems. 

The report states that the private sector used PBL when it was cost effective and 
reduced risk in a noncompetitive environment, at the subsystem and component level. 
PBL is not a preferred tool in the competitive environment because private firms wish to 
take advantage of competition when it is available, and avoid pass through costs that a 
prime integrator might charge. Private firms also placed emphasis on securing or 
maintaining data rights so that they would be protected when the PBL contract was 
complete or terminated, and they had a need to solicit competition for follow-on support. 
With limited funding, DoD program managers sometimes opted to spend limited dollars 
on systems, or system capability, potentially limiting future support options. (GAO, 
August 2004.) Regarding the private sector’s preference to implement at the subsystem 
and component level, the DoD policy for implementation at the time of the report was at 
the platform level (even though much PBL implementation may actually have been 
conducted at the subsystem and component level). GAO contended that PBL at the 
platform level did not reflect the practices of private sector companies and that DoD’s 
policy for implementing performance-based logistics as a preferred support approach at 
the weapon system platform level was based on the false assumption that this was an 
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industry best practice. (GAO, August 2004.) DoD has since revised its policy to reflect 
the preference for implementation whenever feasible, for systems, subsystems, and 
spares. 

Private sector companies are sometimes reluctant to implement PBL in newer 
systems. The commercial firms contend that PBL works best for subsystems and 
components where cost and performance data are sufficient to establish a good BCA. 
That data is often not available for new systems. In the absence of accurate and reliable 
information on system performance (such as on new systems) to establish a baseline for 
evaluating the cost-effectiveness of a performance-based contract, the negotiated price 
might be excessive. (GAO, August 2004.) For example, if the reliability of the 
subsystem or component is greater than expected, the PBL arrangement might not be cost 
effective. This varies somewhat from the DoD policy, which encourages Program 
Managers to consider support strategies (including PBL) during the design phase of 
weapon systems. 

The private sector generally chooses to retain the systems integration function 
(management control), viewing it as a core business function, essential to successful 
business operations. (GAO, August 2004.) DoD guidance does not restrict the selection 
of a Product Support Integrator (PSI) to the government, although it does assign 
responsibility for oversight and follow on assessment to the Program Manager. 

Private companies use PBL in longer-term contracts, usually sole source because 
those run 10-12 years, if they have enough historical data to establish an accurate 
baseline. This is similar to DoD’s use of PBL. DoD guidance provides that the 
preference is to use long-term contracts. The initial investment in implementing PBL can 
be substantial, requiring up-front investments in reliability or maintainability 
enhancements causing short term increases in systems costs. (PBL, March 2005) A long¬ 
term contract allows for a payback period and a chance to realize gains resulting from the 
industry-government partnership. In addition, it may be difficult and expensive to exit 
from a PBL arrangement. Depending on workload allocation, once the PBL contracts are 
established and contractors take over work that was previously performed organically, the 


20 



government frees up the no longer needed resourees for other missions. Thus, those 
resources may no longer be available when the contract ends or is terminated. 

Private sector companies that use performance-based logistics, whether fixed 
price or cost-plus, closely monitor cost and performance information to effectively 
manage their contracts. (GAO, September 2005.) This is to ensure that the expected 
costs under the contracts are accurate and meet the company’s standards; to validate the 
business decision used to justify the PBL arrangement; and to obtain the data necessary to 
renegotiate the contract. DoD also recommends that the military services conduct and 
update their PBL business decisions by revisiting the Business Case Analysis “as needed 
throughout the life cycle.” (PBL, March 2005.) In fact, one of the guiding principles for 
a Business Case Analysis (BCA) is that “BCAs will continue through life cycle process 
with oversight to ensure reassessment at appropriate trigger points...The Services will 
evaluate PBL performance at appropriate decision points.” (PBL, March 2005.) A recent 
GAO study contends that the services are not validating or revisiting the BCAs. The 
study analyzed data from 15 weapon systems programs that the military services had 
identified as having successfully used PBL arrangements. Four of the systems were from 
the Air Force, seven from the Navy, and four from the Army. (All four programs 
identified for study in Chapter III were included in the GAO review.) In all but one case, 
none of the BCAs for the weapon systems had been revisited or updated. (GAO, 
September 2005.) Information contained in the study indicated that government 
information systems were inadequate to provide the type of cost and performance 
information needed to monitor cost and performance, thus they relied on contractor 
information systems, without knowing whether those systems produced accurate data. 
GAO concluded that DoD would not be able to evaluate whether PBL arrangements were 
being implemented effectively and achieving expected results (or savings) until oversight 
and monitoring procedures were in place to ensure the BCA reviews were taking place. 

This concludes the review of the definition of PBL, the PBL implementation 
process, DoD policy and guidance, status of DoD implementation and current industry 
practices. The next section of this chapter is a review of the Organizational Systems 
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Framework, the systems approaeh this study uses to identify design factors that influence 
PBL implementation. 

G. ORGANIZATIONAL SYSTEMS FRAMEWORK 

The Organizational Systems Framework (Roberts, 2000) is a construct used to 
describe how inputs (environment, success factors, and system direction) interact with 
throughputs (tasks/jobs, technology, structure, people, and process/subsystems) to 
influence results (culture, outputs, and outcomes). This model views the organization as 
a product consisting of a group of interacting elements (Bruner, 1998). As organizations 
develop, throughputs (design factors) and results provide feedback to the system, further 
influencing different variables, e.g., feedback loops. Although organization charts vary 
from one organization to another, the basic structure defines the way the organization 
communicates and makes decisions. 


The following chart gives a breakdown and a brief description of the elements 
contained in the Organizational Systems Framework: 


Organizational Systems Framework 

Inputs-► Throughput-► Results 



Professor Nancy Roberts 1/2000 



Design Factors 


Figure 2. 


Organizational Systems Framework. 
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1, Inputs 

According to the Organizational Systems Framework, the inputs of an 
organization are those elements that influenee the design faetors, eulture, outputs, and 
outeomes of the organization. “They’re the material that the organization has to work 
with” (Nadler/Tushman, 1988). Basie inputs eonsist of the following: 

a. Environment 

Aeeording to Roberts (Roberts, 2003), there is a “permeable” boundary 
that separates the organization from the environment. The organization is eonstantly 
interaeting with the environment. In order for it to operate at an optimum level, the 
organization must ehange and make adjustments as the environment ehanges. In eontrast, 
there is an impaet on the environment as the organization ehanges. Roberts (2003) makes 
this point elear in her statement, “Mutual adaptation between the organization and its 
environment is a basie feature of an open system.” An “open system” is a system that 
interaets with the environment. Or, as Nadler/Tushman put it, “These elements make up 
a meehanism that takes input from the environment, subjeets it to some form of 
transformation proeess, and produees outpuf’ (Nadler/Tushman, 1988). Throughput is 
the proeess where environmental inputs are proeessed and eonverted into outputs. This 
must take plaee in order for the organization to survive (Roberts, 2003). Examples of 
environmental influenees are the politieal/eeonomieal/soeial/teehnologieal faetors that 
ereate opportunities, mandates, and restrietions. 

b. Key Success Factors 

The key sueeess faetors of the organization are the neeessary eomponents 
that must exist for the system to be sueeessful. Key sueeess faetors are the methods by 
whieh the organization uses its resourees, how it strategizes, and how it aehieves its 
mission. Also ineluded are key leader roles, erisis management methods, and the 
objeetives/restraints the organization faees. Eaeh organization is unique and therefore 
eonsists of different faetors that make it sueeessful. It is eommon that sueeess faetors of 
a private firm will be more distinet and defined than those of publie organizations 
(Bruner, 1998). 
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c. System Direction 

There are implieit and explicit elements influencing an organization’s 
direction. System direction is a lever that espouses where the organization is headed. 
Examples of system direction mechanisms are the mission, values, beliefs, vision, goals, 
and strategies of the organization. Identifying and clarifying direction can be the first 
charge of leadership. The mission is what the organization does, for whom, and how 
tasks are accomplished. The values and beliefs are implied or written and can be 
described as the “mode of conduct” that the organization supports (Roberts, 2003). The 
vision is how the organization sees itself in the future. It defines the efforts required to 
achieve success. Goals are the actions that will be achieved; however, they differ from 
objectives in terms of specific actions expected to be accomplished within a specific 
timeframe. Strategies spell out how the organization will get from a current state to a 
desired future state. According to Roberts, strategy “is usually described in terms of a 
ploy that is pursued to outmaneuver opponents or competitors, or a position the 
organization takes in terms of markets or customers, or a perspective assumed in terms of 
its theory of doing business. Strategy can be intended as in a plan that looks ahead to the 
future, or strategy can be realized from a pattern of activity that emerges over time.” 
(Roberts, 2003) 

2. Throughputs 

Throughputs are the design factors that convert inputs into outputs, outcomes and 
organizational culture. These are often the internal workings of an organization that 
interact in ways that can be congruent or incongruent, thereby depicting the hypothesis 
that “fit” determines performance. Throughputs are described in more detail as follows: 
a. Tasks/Jobs 

Tasks are designed according to the nature of the work to be performed. 
Each organization is designed differently, and therefore each job contains different, 
specific, and unique task arrangements. The organization is set up to perform tasks that 
are consistent with the strategies. The skills required to perform the work, the types of 
rewards the work provides, and the constraints in place are what make up the analysis of 
the tasks (Nadler/Tushman, 1988). The level of understanding of those tasks within the 
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organization and how well the tasks fit with other design elements are an integral part of 
the systems framework. 

b. Technology 

Teehnology plays a erueial part in eonverting inputs to outputs. There are 
different types of interdependeneies (pooled, sequential, or reeiproeal), whieh eategorize 
how work flows within eaeh organization. Teehnology is how the work gets done and 
how it progresses through a eyele. When aeeomplishing various tasks, teehnology is one 
element that determines how the organization produees outputs. Teehnology also 
eonsists of the equipment and physieal faeilities being used to aoeomplish tasks. 
(Roberts, 2003) 

c. Structure 

The strueture of an organization eonsists of “the basie groupings of 
aetivities and people” (Bruner, 1998). Strueture ineludes the fundamental shape, 
integrating deviees, and eoordinating methods that pull the various groupings together. 
Aetivities and tasks are eombined to form and define the strueture, based on the 
hierarehy, task forees, matrix, networks, integrating roles, and integrating departments 
within the organization. (Bruner, 1998) 

d. People 

This design faetor is eharaeterized by the knowledge, skills, abilities, 
motives, expeetations, and mindset of the people in the organization. Experienee base, 
edueation, and demographie baekground are also eonsidered as part of this element. 

e. Process/Subsystems 

This design faetor eontains various faeets ineluding aeeounting, fmaneial, 

and payroll proeesses. It also ineludes the following sub-elements: 

• Human Resouree Management - how the organization reeruits, seleets, 
promotes, terminates, retires, retains, rotates their people - how the 
organization trains and develops people - how formal rewards are 
presented - how eompensation is granted. 

• Finaneial Management, Measurement & Controls - how people are held 
aeeountable for resourees - affeets of aoeountability meehanisms on 
behavior. 
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• Communication Information Planning and Decision Making - how 

information is communicated for planning and deeision making purposes 

- how information is gathered, proeessed, distributed, and evaluated 

• Aequisition & Contraeting. How the aequisition proeess is managed. 

3. Results 

Results are eomprised of the eulture, outputs, and outeomes that are aehieved after 
the inputs have influeneed the throughputs, and the design faetors (throughputs) have 
gone through the conversion proeess. Organizations are measured for efficiency and 
effectiveness based on the results they generate. The culture, outputs, and outcomes are 
defined as follows: 

a. Culture 

Culture deseribes how the people within the organization interaet, manage 
eonflict, and treat one another. Culture also has a bearing on the way the organization fits 
the larger environment. Many organizations eontain subeultures that ean impede or 

faeilitate the integration of efforts (Roberts, 2003). 

b. Outputs 

The goods and serviees the organization produces are the outputs. Outputs 
are measured based on how well the organization uses its resourees and whether they 
meet their objeetives. Outputs are based on the method of measurement, whieh result in 
the organization’s performanee indieator. (Bruner, 1998) 

c. Outcomes 

“Outcomes deal with the implieations and eonsequences that outputs have 
on stakeholders and how the outputs are interpreted in view of the environment. In order 
to be an integrated system, the outcomes must feedback to the environment and also to 
the design faetors.” (Bruner, 1998) 

Through the Organizational Systems Framework, this study analyzes the 
three speeifie design factors (throughputs), people, proeess, and strueture of four different 
organizations to show how those factors influenced the way PBL was implemented. 

H. SUMMARY 

This ehapter deseribes PBL and the PBL methodology. It eontains a literary 
review of the 12-step proeess for implementation, DoD poliey, industry praetiees, and the 
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implementation status within the DoD services. This chapter also describes the 
Organizational Systems Framework and identifies the design factors that convert inputs 
into outputs. The next chapter explains the interview process and gives a general 
description of the four Navy PBL Programs as well as the Army’s Standard Automotive 
Tool Set (SATS) Program at TACOM. 


27 



THIS PAGE INTENTIONALLY LEET BLANK 


28 



III. DESCRIPTION OF SELECTED PROGRAMS 


A. INTRODUCTION 

This chapter discusses the interview proeess, expeeted results, the four PBL 
Programs, and the TACOM SATS Program. The strategy of the interview proeess is 
designed to uneover details about the organizational design faetors of people, proeesses, 
and strueture of the program offices that implemented PBL. 

B, THE INTERVIEW PROCESS 

Five interview questions about PBL and organizations have been developed for 
the Navy PBL Programs. With these questions, semi-structured interviews were 
eondueted with personnel from four Navy program/projeet offiees who have fully 
implemented PBL support strategies. The interviews eonsisted of upper management, 
middle management, and funetional program managers from eaeh of the four Navy 
programs identified earlier. The interview questions were sent to interviewees via email. 
Onee all written interviews were eompleted and reviewed, eaeh interviewee was 
eontaeted for follow-up questions/olarifieations. 

The interview questions are as follows: 

(1) How is your organization struetured? 

(2) How did your strueture ehange as PBL was implemented (or did it)? 

(3) What organizational design elements had a positive or negative impact on 
PBL implementation? 

(4) If you eould go baek and change anything during the implementation 
phase, what would it be and why? 

(5) What post-PBL implementation results have you seen or experieneed? 

Question 1: How is your organization structured? Through this question, 

information was gathered to find out if the team(s) were struetured as Integrated Produet 
Teams (IPTs) or if they worked in stovepipe organizations. If they were IPTs, what 
funetions were represented and how were the funetions separated. Identifieation of the 
Produet Support Integrator (PSI) or Assoeiate Systems Logisties Manager (ASLM) was 
also requested for each program. Final analysis focuses on the understanding of the 
organizational motives, relationships, expeetations, and mindsets of each interviewee(s). 
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Question 2: How did your structure change as PBL was implemented (or did it)? 
By identifying how the organization was perceived before and after PBL, interview 
results show the changes and the positive/negative affects. Interview results also defined 
whether the teams were already in place (and had to adapt accordingly) or if they were 
formed solely for the PBL effort. Follow-on discussions included training issues, 
intended/unintended consequences, and strategies for success. 

Question 3: What organizational design elements had a positive or negative 
impact on PBL implementation? Qrganizational design is defined based on the 
environment, technology, personalities, available resources, norms, tasks, and many other 
elements. By choosing subject matter experts to interview, accurate details were captured 
that help distinguish the characteristics that led to success. 

Question 4: If you could go back and change anything during the implementation 
phase, what would it be and why? Hindsight is 20/20, but learning and improvement 
comes from experience. As interviewees identified the factors that contributed to the 
successful effort and issues that restrained their efforts, lessons-learned were formed. 
The results spell out the short term and long term implications and the elements believed 
to be the biggest challenges/obstacles. 

Question 5: What post-PBL implementation results have you seen or 
experienced? With this question, we were looking for the gaps between the intended 
gains and the identifiable outcomes. 

The interview questions were specifically designed to capture the opinions, 
attitudes, and experiences of the subject matter experts that worked the Navy programs. 
The respondents were guaranteed that their names would not be used in any portion of 
this report or divulged to anyone outside the project. The information gathered from the 
interviews was solely used to develop a general understanding and analysis of the 
organizational design factors and leadership traits of each group as they worked toward 
fully implementing a PBL program. 
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Once the interviews were eompleted, analyzed, and the design faetors of the 
organizations identified, those faetors were applied to the Army SATS Program. Semi- 
struetured interviews were eondueted with SATS team members and eonsisted of the 
following questions: 

(1) How is your organization struetured? 

(2) What is your attitude toward PBL? 

(3) What signifieant ehanges has your organization experieneed in the past 
five years, and how were they reeeived? 

(4) How do you feel about eontraeting for performanee when the support 
strategy has traditionally been organie? 

C. EXPECTED RESULTS 

Although the four Navy programs were totally different efforts, they were all 
performed under the same serviee, and they all generated measurable results. Common 
organizational design faetors exist within eaeh of these programs, and those eommon 
faetors eontributed to sueeesses. The design faetors of teaming, training, and leadership 
are distinet areas of organizational design where eommonalities appeared. We were able 
to identify the eharaeteristies that led to sueeess by earefully analyzing the design 
elements of the organizational systems framework as they pertained to eaeh of the 
program offiees investigated. 

D. THE PBL PROGRAMS 

The researeh was eondueted on four Navy programs that have fully implemented 
Performanee-Based Logisties. The original intent was to researeh and analyze three 
Army programs, but initial reviews indieated that the Army was lagging behind the other 
serviees in implementation. In order to explore the organizational strueture of programs 
using PBL fully, it beeame neeessary to analyze programs in whieh PBL has been fully 
implemented and lessons learned are available. Further, all four programs have been 
seleeted from one military serviee (Navy) to avoid ineonsistent data resulting from the 
differenees in proeedures from serviee to serviee. 

The four Navy programs that have fully implemented PBL are identified as 
follows: 


31 



(1) The F/A-18 E/F Integrated Readiness Support Teaming (FIRST) 

(2) AN/ALR-67(v)3 Radar Warning System (RWS) Receivers 

(3) Auxiliary Power Units (APUs) 

(4) F404 Engines 

These programs are briefly described below. 

1. F/A-18 E/F Integrated Readiness Support Teaming (FIRST) 

The single seat F/A-18E and two-seat F/A-18F Super Hornets perform a variety 
of missions including day and night strikes with precision-guided weapons, fighter escort, 
suppression of enemy air defense, reconnaissance, forward air controller and tanker. The 
aircraft has 11 weapon stations, which allow for a significant degree of payload flexibility 
with the capability to carry a variety of both air-to-air and air-to-ground ordnance on one 
mission. 

The F/A-18 E/F FIRST program was designed to improve readiness and lower 
support costs for the F/A-18 E/F Super Hornet. The FIRST vision statement was to: 
“Develop and implement an F/A-18E/F support plan that will achieve and sustain CNO 
readiness goals and provide significant reductions in weapon system ownership cost 
through government/industry partnership, supply chain management, reliability 
engineering/improvement, integrated information systems. Hornet support network, and 
performance-based contracting.” (F/A 18E/F Powerpoint, undated) WithNAVICP acting 
as the Product Support Integrator, the Navy awarded Boeing a two-year contract for 
approximately $252 Million in May 2001. With options, the total contract amount could 
reach $750M over a five-year period. Under this contract, Boeing provides full logistics 
support including supply chain support, reliability improvements, obsolescence 
management, technical publication, and support equipment management for 
approximately 850 components unique to the F/A-18E/F aircraft. (Navy is responsible 
for components that are common to E/F, and C/D. DFA was the primary source of 
common consumables.) Under this “partnership”, the Navy retained configuration 
control, system safety, base-supply (or retail) material allowances, and organizational, 
intermediate and depot maintenance. Naval Aviation Depots provided touch labor 
needed for repairs and upgrades under commercial services agreements with Boeing. 
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Reported metries sueh as the inerease in material availability (from 62% t 85%), the 
sueeessful launch rate (97%), and the reduction in repair cost per hour indicate that the 
Navy has already reduced total cost of ownership while substantially increasing readiness 
of the system. 

2. AN/ALR-67(v)3 Radar Warning Receivers 

The ALR-67(v)(3) Radar Warning System (RWS) provides advanced techniques 
to detect threat radar emitters. It enhances the survivability of aircraft and aircrews by 
providing improved situational awareness in complex electronic warfare environments. 
This includes emitter identification, extended capabilities in detection and processing, 
threat location, and potential lethality. This Radar Warning System is used on the F/A- 
18E/F and C/Ds. 

In September 1999, NAVICP awarded a six-year, $58.5 million performance- 
based logistics contract to Raytheon Systems Sensor and Electronics Division, Goleta, 
CA. At the time of the award, the RWS was a new, non-fielded system for which no 
organic production or repair capability existed. Under this contract, Raytheon is the full 
service provider with the Navy retaining integration responsibility. Raytheon’s 
responsibilities include reliability improvements, maintenance of wholesale inventory, 
obsolescence management, and configuration management. The structure of the contract 
is designed to provide incentives for Raytheon to use best commercial practices and to 
pioneer innovations and efficiencies to further reduce total life cycle costs. 

3, Auxiliary Power Units (APUs) 

Another PBL effort that supports the P/A-18 is the contract with Honeywell for 
the Auxiliary Power Units (APUs). This PBE effort supports four different APUs used 
on the C-2, P/A-18, S-3, and P-3 aircraft. The contracts are set up as 10-year, firm fixed 
price public/private partnerships between NAVICP, Navy Aviation Depot (NADEP) 
Cherry Point and Honeywell. The APU efforts are referred to as “Power-by-the-Hour” 
because of the aggressive Total Eogistics Support strategy. The contract includes 
incentives for Honeywell Defense and Space to provide continuous process 
improvements for the APUs, along with associated logistics support. 
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Under the eontraet, Honeywell is responsible for 90 pereent on-time delivery. 
They are eommitted to routine stoek replenishment in the U.S. within five days, priority 
shipments within two days, and outside the U.S. within 4 days (eompared to an average 
of 35 days under past agreements). Ineentives inelude payment adjustments if the metries 
are not met. This PBL eontraet has a “storefront” eoneept for material management, with 
restored eonfiguration stability. Ninety-eight pereent of the requisitions are filled within 
the eontraetual requirements. Supply material availability at depots has inereased to 
95%, with zero repairs awaiting parts. 

This PBL program provides distribution, inventory, eomponent repair and 
overhaul, eomponent reliability management, guaranteed availability, program 
management, training/information management options, and predietable priee and 
performanee. The seope of these PBL efforts results in a guaranteed serviee level and is 
also eonsidered to be one of the best eommereial praetiees in tailored DoD eustomer 
solutions. 

4. F404 Engine 

The F404 is a family of engines that has powered multiple aireraft sinee the 
1980s, performing a broad speetrum of missions from low-level attaek to high-altitude 
intereeptors. In August of 2003, the Naval Air Systems Command (NAVAIR) awarded a 
five-year, Performanee-Based Logisties (PBL) eontraet to General Eleetrie Aireraft 
Engines (GEAE). The eontraet value was estimated at $510 million. It also eontains a 
five-year option period estimated at $600 million if exereised. The eontraet was drafted 
to support the Naval Aviation Depot’s E404 engine repair lines, whieh depend on an 
uninterrupted flow of pieee parts for ready-for-issue engines, modules, and eomponents. 
Under this eontraet, GEAE is to provide full logisties support ineluding supply ehain 
support, reliability improvements, and obsoleseenee management. The Navy retained 
eonfiguration eontrol and the Naval Aviation Depot (Jaeksonville) provides toueh labor 
for repairs under a eommereial serviees agreement with GEAE. Established metries 
inelude availability and reliability. 
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E, THE TACOM ARMY SATS PROGRAM 

The Army’s SATS Program is an Acquisition Category (ACAT) III program and 
was selected as a PBL candidate in 2004. A minimal amount of effort has been expended 
to push the SATS through the steps toward implementation of PBL. Clear guidance has 
not been provided through the Army channels to facilitate implementation in a reasonable 
amount of time. The SATS IPT team has continued to operate under a traditional IPT 
structure, utilizing the organic support system. 

The Standard Automotive Tool Set (SATS) is a modular concept designed to 
“replace the most common organizational and direct support tool sets.” (PEO Memo, 
2004). The SATS consolidates the Army’s antiquated basic automotive tool sets into an 
easily inventoried, single standardized, mobile and quickly deployable tool set that 
supports all levels of automotive maintenance. The concept makes the set C-130 
deployable and significantly optimizes the logistics footprint, which supports the two- 
level maintenance and Army’s transformation for the future. The SATS is a 
containerized shop set, consisting of a core set and various modular packages to support a 
unit’s field level maintenance mission (PEO Memo, 2004). 

The initial SATS IPT formed sometime in 2001 when the SATS was a conceptual 
system. The first three years were spent investigating and defining the Army’s fielding 
requirements and developing the Operational Requirements Document (ORD). Once the 
ORD was in place, staffing of the Milestone Decision package began. As the 
organization underwent a landmark transformation to become its own Product Manager, 
the SATS IPT team worked to familiarize themselves with the Milestone Decision 
process and all associated requirements documentation. 

Because this was an integration effort, staffing began at Milestone B. While the 
Milestone Decision documentation was being staffed, the requirement for SATS was 
competed among a pre-established pool of qualified contractors. After well over a year’s 
effort. Milestone B was approved, and the successful contractor was authorized to enter 
into Eow-Rate Initial Production (TRIP). 
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Just before the Milestone B paekage was sent to the Program Executive Office 
(PEO) for approval, a new PEO was assigned. The new PEO selected the SATS as a 
PBE candidate. A single point of contact (POC) (outside the IPX but within the TACOM 
organization) was assigned to process and report on PBE efforts. This POC coordinates 
primarily with the Systems Acquisition Manager (SAM) to gather data for PBE reporting. 
To date, the SATS PBE has been processed through a series of steps to determine 
appropriate course of action. 

F. SUMMARY 

This chapter explained the interview process and the methods to be used for 
gathering data from the subject matter experts, along with expected results. It has also 
provided a brief description of each of the programs that have implemented PBE and a 
description of the TACOM SATS Program. The next chapter describes the interview 
results and contains the findings as they relate to the organizational design factors and 
implementation of PBE. 
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IV. FINDINGS AND RESULTS 


A. INTRODUCTION 

This chapter describes the results of interviews with individuals from the four 
PBL Programs and the Standard Automotive Tool Set (SATS) IPT described in Chapter 
III. 

B, RESULTS OF INTERVIEWS 

Points of Contact (POCs) were identified from three levels (upper management, 
middle management and functional) for each PBL IPT. There were a total of 17 POCs 
for the four PBL IPTs and five POCs from the SATS IPT. Initial contact was via email. 
Each POC for the four PBL programs was forwarded the same five questions. The 
questions for the SATS IPT members were slightly different, as the SATS team has not 
yet implemented PBL. Email reminders were sent and follow-up telephone calls were 
placed in an attempt to involve participants who did not respond. Seven of those who did 
not respond to the initial request, did not respond at all. Eollow-up telephone interviews 
were conducted to obtain clarification and insight into additional areas of interest that 
surfaced in email responses. The results are first grouped by program and interview 
question, and then by the organizational design factors of structure, people, and 
processes. The data presented is a combination of information obtained from the email 
responses and follow-up telephone interviews. 

1. F/A-18 E/F First 

Three individuals on the PBE IPT team for the F/A-18 E/F were contacted, one 
each at the upper management, middle management and functional levels. The two 
individuals from the upper and middle manager levels did not respond. The individual 
who responded participated in the IPT as a contract specialist. A follow-on interview 
was conducted via phone after the initial electronic response. 

Question 1: How is your organization structured? 

The interviewee explained that the initial PBE implementation team consisted of 
approximately 30 people representing the stakeholders of NAVAIR, NAVICP, the repair 
depots, the prime contractor and major subcontractors. Defense Contract Audit Agency 
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(DCAA), and Defense Contraet Management Ageney (DCMA). They were not eo- 
loeated. The 30 individuals were speeialists from various diseiplines. Speeifieally 
named were metries speeialists, support equipment speeialists, repair speeialists, and fleet 
operations speeialists. Some team members were assigned to the F/A-18 E/F PBL effort 
full time, while others were expeeted to partieipate on the team and fulfill other job 
assignments simultaneously. The team initially met off-site to minimize distraetions 
from other duties. 

In addition to the PBL implementation team deseribed above, the organization 
also ineluded an Exeeutive Steering Committee made up of the highest level of team 
members. This steering eommittee met regularly to traek and ensure progress, and 
“strategize future aetions.” 

During the follow-on interview, this IPT member was asked to identify the PSI. 
He stated that he did not believe that speeifie term (PSI) was used, but deseribed the 
Program Manager as being primarily responsible for ensuring “that everything to keep 
the plane flying gets done.” 

Question 2: How did our strueture ehange as PBL was implemented (or did it?)? 

The interviewee responded that the EIRST team was ereated solely for the PBL 
effort. The E/A-18 E/E was a new aireraft at the time PBL was implemented, therefore 
no pre-existing traditional support or organie repair. There were no signifieant ehanges 
to the organization as implementation oeeurred. 

During the follow-on interview, the IPT member was queried about PBL training. 
He stated that the IPT did not reeeive any group or formal training. 

Question 3: What organizational design elements had a positive or negative 
impaet on PBL implementation? 

The interviewee stated that during initial off-site IPT meetings, teams were 
assigned aetion items with due dates. The team leader was responsible for ensuring that 
the team eompleted the aetion item. He said those assignments led to aeeountability, 
whieh was invaluable. 
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The interviewee also mentioned that individual personalities of team members 
had a positive effeet on implementation. He explained that the team make-up promoted 
progress beeause it ineluded some high level members who were motivated, dedieated, 
eooperative, and strong willed. 

Question 4: If you eould go baek and change anything during the implementation 
phase, what would it be and why? 

The interviewee stated that if he were to change anything during implementation, 
it would be the contract period as it related to funding streams. The FIRST contract 
period was on a fiscal year basis, however some of the funding streams were not made 
available until well into the first quarter of the fiscal year, clearly an impediment to 
performance. 

The IPT member also identified senior management level buy-in as a factor that 
contributed to success. He stated that although they attempted to keep senior level 
managers informed as the program progressed, there were still some “hiccups” and if he 
were to change anything about the process, it would be to go “overboard” in this area. 

Question 5: What post-PBL implementation results have you seen or 
experienced? 

The interviewee stated that the fleet is satisfied with the support they receive from 
implementation of PBL. He also stated that the BCA had been updated with a revised 
“gain” amount, and the analysis still showed PBL as “a winner.” He was not aware of 
any PBL efforts that have not resulted in a break even or better situation. 

2, AN/ALR-67(v)3 Radar Warning Receivers 

Interview requests were sent to five team members who participated on the 
AN/ALR-67(v)3 Radar Warning System (RWS) PBL IPT. Qne person responded to the 
request via email. A second individual agreed to participate in a short telephone 
interview. The two interviewees were functional level team members from the 
contracting and logistics fields. Three people (one from each upper, middle, and function 
level) did not respond. 
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Question 1: How is your organization structured? 

The organization consisted of multiple Acquisition Planning Teams (APTs) that 
managed systems at a broad level. When the PBL effort was initiated, a PBL IPT was 
formed as an extension of their APT. The PBL IPT works specifically on the PBL 
contracting arrangement for the Radar Warning Receivers. The PBL IPT consists of 
subject matter experts (SMEs) in the areas of contracting, logistics, program 
management, item management, hardware NAVAIR, Navy Supply Command 
(NAVSUP), and contractor staff. The IPT team was formed at inception of the PBL 
assignment, and they are still intact today. Program Management Reviews (PMRs) are 
conducted every six months. 

There was inconsistency in responses from the interviewees when asked who lead 
the IPT. One stated it was the avionics PBL team leader, and the other said it was the 
contracting team leader. The response was similar when asked who was assigned as the 
Product Support Integrator (PSI). One named an individual from the Supply Chain 
Solutions Office, and the other person did not know. Both interviewees stated that they 
were unfamiliar with the term PSI and thought that the Navy used another term to 
identify someone in a PSI role, however, they were unable to provide the term. 

The interviewees were asked who was responsible for completing the Business 
Case Analysis (BCA) and if the IPT was aware of the BCA contents. The interviewees 
responded that a group called the “price fighters” prepared the BCA for the Supply Chain 
Solutions Office, and that the IPT members are fairly familiar with its contents. They 
added that the BCA is populated based on a Rough Order of Magnitude (ROM) 
submitted by the PBL contractor. 

Question 2: How did your structure change as PBL was implemented (or did it)? 

The structure changed minimally as the teams became more defined under the 
PBL effort. The PBL team consisted of 10-12 core members and also included the 
contractor. Additional subject matter experts (e.g. engineering, technical, attorneys, 
quality, etc.) were called in when necessary. 
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The interviewees reported that the IPX reeeived minimal formal or informal PBL 
training. A short kiekoff training session was eondueted, and there may have been some 
other initial training when PBL started. Interviewees were unsure who eondueted the 
kickoff training (it may have been the Supply Chain Solutions Office.) They added that 
personnel in their organization are becoming more knowledgeable about PBL as their 
level of involvement and the experience with PBL increases. 

Question 3: What organizational design elements had a positive or negative 
impact on PBL implementation? 

The interviewees reported that the continuity of team members from the APT to 
the IPT had a positive impact on the overall success of PBL implementation. The PBL 
IPT worked very well together, and their efforts were supported by great leadership. 
Attitudes were positive, dedication was high, and the team acted as a cohesive unit. 

Interviewees provided information on a formal and informal reward system. They 
stated that upper management recognized PBL team efforts by giving out team 
performance awards. Team members also received increased exposure for promotions 
and other job assignments based on the experiences they gained working on the PBL 
team. 

Interviewees reported that although there may have been some apprehension 
initially, there was no longer any negativity or fear associated with the possibility of 
contracting themselves out of a job. No one has been displaced due to PBL 
implementation, however, many job duties have shifted. 

The IPT members were assigned to the PBL effort in addition to their regular 
duties. Managing the new assignment, as well as the pre-existing responsibilities, may 
have had some negative impact. Team members prioritized and managed their workload 
as efficiently as possible so that neither the pre-existing workload nor the new duties 
suffered. 
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Question 4: If you could go back and change anything during the implementation 
phase, what would it be and why? 

The interviewees reported that one of the biggest challenges was communication. 
There were many instances where last minute issues/questions became showstoppers. 
This could have been avoided if communication had been more specific and timely, and 
by making sure all levels of management and the necessary players were informed of 
progress. Subject matter experts should be brought in during the implementation phase 
so they are familiar with the phases, goals, and objectives. 

Question 5: What post-PBL implementation results have you seen or 
experienced? 

Qne interviewee reported that the team negotiated equitable adjustments because 
projections for repairs, materials, pricing, and support were overly optimistic. Qther 
changes and production problems also contributed to the negotiation of equitable 
adjustments. 

There were also gaps between initial flight hour projections and what was actually 
experienced. There was a contract provision to decrement the award fee if the 
percentages fell short of the projections. Although the contract specified a minimum 
acceptable level of performance and that level was met, there were incentive goals that 
the contractor was unable to meet. 

The interviewees reported that the Supply Chain Solutions Qffice has initiated a 
Lean Six Sigma effort for the PBL implementation process. Currently, the average time 
to implement PBL is two years. The Lean Six Sigma team hopes to reduce the 
implementation time to 14 months. 

3. Auxiliary Power Units (APUs) 

Interview requests were sent to three team members who participated on the 
Auxiliary Power Unit (APU) PBL. Two team members responded. The two individuals 
who responded were at the functional level. Their functions on the team were that of 
logistician and policy/staff support. The individual who did not respond was from the 
middle management level. 
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Question 1: How is your organization structured? 

The two interviewees were consistent in their description of the organizational 
structure. The organization operated in an IPT environment. The APU IPT was created 
specifically to implement PBL and consisted of specialists from various functions 
(engineering, contracting, logistics, quality, contractor staff, depot, etc.). Although the 
APU IPT members were accustomed to working in IPTs, they were not familiar with 
PBLs and had never worked as an IPT on a PBL Program. The policy/staff interviewee 
indicated that the APU PBL assignment was in addition to other duties and that his office 
(Supply Chain Solutions) was responsible for processing the Business Case Analysis 
(BCA). 

The original IPT was not co-located and thus conducted some team meetings 
through virtual (electronic) IPTs. The interviewees stated that this means of conducting 
meetings seemed to have somewhat of a negative impact on the amount of time it took to 
process actions/issues. 

The interviewees were asked who was assigned the role of Product Support 
Integrator (PSI). The logistics/program manager responded that he acted as the IPT lead, 
as well as the PSI. The other interviewee responded that the weapon system manager 
was always the IPT lead, and the weapons team acted as the PSI. 

Question 2: How did your structure change as PBL was implemented (or did it)? 

The interviewees saw no major changes to structure as implementation occurred. 
As the PBL initiative was formed, however, the IPT became more structured and orderly 
to accommodate the new mission. Both individuals indicated that the original IPT was 
too large. In order to be more effective, upper management directed the IPT be pared 
down to a manageable working group of 10-12 core members. Both interviewees agreed 
that once the core IPT was established, the group was much more efficient and 
productive. 

The interviewees reported that formal training is provided to the IPT members 
and contractor staff. This kickoff training is conducted by a staff support group called the 
Supply Chain Solutions Qffice, but it has only recently become available. During the 
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formation of the APU PBL IPX, there was no formal training available, and there were no 
mandatory Defense Aequisition University (DAU) eourse requirements. One interviewee 
reported that most logistieians and program managers have completed the Acquisition, 
Technology, and Logistics (AT&L) Workforce Certification requirements and are 
certified at Level III in Acquisition Logistics. He also stated that, within the certification 
requirement, there is a logistics class that focuses primarily on PBL (LOG 235). 

There were no personnel reductions as a result of implementation of PBL, but 
there were shifts in responsibility. There was no major concern that the effort would 
negatively impact government jobs; however, the IPT members were initially 
apprehensive because the change to PBL put them out of their comfort zone. 

Question 3: What organizational design elements had a positive or negative 
impact on PBL implementation? 

One interviewee stated that the “persistent personalities” of IPT members 
contributed to the success of the PBL effort. Especially noteworthy were the persistence 
of the senior executive officer and the lead contracting official. These individuals had a 
vision that 100% of General Electric (GE) engines would be PBEs, and 80% of 
repairables would be PBLs. Both interviewees felt that their constant push had a positive 
impact on the team communications, maintaining the needed strength and consistency for 
successful implementation of PBE on this program. 

Upper management was very supportive, and this proved to be a key element, 
especially as the team worked through the confusion and lack of enthusiasm in the initial 
stages of implementation. The personnel in the organization have become more receptive 
to PBE as the level of experience has increased and the guidance has become more 
available. 

One factor that began negatively ended up having a positive impact. Interviewees 
were asked if IPT members were apprehensive about PBE because of a possible risk of 
“contracting themselves out of a job.” Although they have seen a shift in responsibilities 
as duties/focus changed, there has not been any displacement of government personnel. 
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They added that the PBL effort actually turned out to be an effective method in dealing 
with reduced human resources and an increased workload. 

Question 4: If you could go back and change anything during the implementation 
phase, what would it be and why? 

Both interviewees felt they should have structured a leaner IPX earlier than they 
did. They found it was difficult to manage the team or get things done because there 
were too many conflicting personalities and priorities. They stated that if they could do it 
over, they would suggest that all stakeholders be brought together for an initial meeting, 
and then establish a “lean” IPT, possibly with sub-IPTs if necessary. 

Both interviewees also mentioned problems with metrics. They responded that 
metrics should have been structured and defined differently. The APU PBL program 
used reliability metrics, which were difficult to assess. Also, during the initial stages, the 
IPT assumed reliability to be better than it actually was. One of the interviewees 
attributed this to ECPs that would have affected reliability, but were not implemented in a 
timely manner. As a result, the contractor experienced more failures than predicted. The 
interviewee felt this put the contractor in a position where it would be impossible to 
receive incentive payments because they could not meet the contract metrics. During the 
first few years, the contractor was trying to “dig themselves out of a hole” and was 
actually in a situation where they could have been penalized. If they could do things 
over, the team would “consult with metrics and reliability experts...or do away with 
reliability metrics entirely...” They suggested that “availability” might have been a 
better measurement because, in a firm fixed price contract, the contractor is inherently 
incentivised to improve reliability. To explain further, if the APUs last longer, the 
contractor is responsible for providing fewer units, thus profit to the contractor increases. 
As a result of these issues, the Supply Chain Solutions Office is now in the process of 
refining the link between wholesale to retail metrics. 

One interviewee responded that there was a great loss of time initially working 
toward a sole-source arrangement, a concept proposed by the PBL provider. A 
considerable amount of time was lost working through the Title 10 issues of depot core 
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workload. The strategy was later revised and ultimately evolved into a partnership 
agreement between the PBL eontractor and the depot. If they were to do it over, they 
would have started with the partnership eoncept. It may have required more interaetion 
with the depot up front (initially, the depots were apprehensive about the ehange because 
they felt it would be taking their work away), but ultimately would have saved the two 
years of wasted time spent pursuing the sole source arrangement. 

Finally, one interviewee mentioned that the team realized, in hindsight, they could 
have benefited from an expanded base and potentially lower costs had they engaged 
Foreign Military Sales (FMS) customers immediately in the implementation process. 

Question 5: What post-PBL implementation results have you seen or 
experienced? 

“Unprecedented improvement in APU program health” was one interviewee’s 
response. Compared to the traditional support approach, the PBL effort has already 
saved millions of dollars. The team philosophy as PBL was implemented was to break 
even or better, even though cost may not always be the most important element of PBL. 
One interviewee reported that there were critics who focused entirely on cost and were 
quick to accuse the IPT of “buying too much performance”. The interviewees felt that 
this PBL program has proven that with increased reliability and performance, cost 
benefits will naturally be realized over a period of time. 

Another post implementation result reported by one interviewee is that the Supply 
Chain Solutions Office has initiated a Lean Six Sigma effort intended to reduce the time 
required for PBL implementation. 

4. F404 Engines 

Interview questions were sent to six individuals identified as members of the F404 
PBL implementation IPT. Four responses were received (one from upper management 
level, two from middle management level, and one from the functional level.) One 
member was not involved in the beginning of the program, but came on board to replace 
an exiting member after the PBL contract was awarded. The other three interviewees 
were involved during the PBL IPT start up. The functions represented by the 
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interviewees include program manager, logistics, and contracting. Follow-up interviews 
were conducted by telephone. 

Question 1: How is your organization structured? 

Although the descriptions of the organization varied slightly, the interviewees all 
stated that the NAVICP organization utilizes an IPX structure (and has done so for 
approximately 10 years), with each team supporting an airframe or platform. Because the 
engine crosses various platforms, the engine IPX exists at the component level. Xhe 
engine IPX has four branches. Xhey consist of two branches for engine component 
support, one branch for technical support, and a Whole Engine Management Branch. Xhe 
logistics and procurement IPX members are co-located. Personnel serve simultaneously 
on multiple IPXs. 

Xhe engine IPX became the PBL implementation IPX when they were assigned 
the task of implementing PBL on the program. Xhe task assignment came from NAVICP 
upper management. Xhe IPX members necessary for daily activities and execution were 
considered core members. Logistics and contracting personnel were specifically 
identified as core members. Other IPX members including customers, a policy group 
called “Supply Chain Solutions”, Quality Assurance, Engineering, General Electrics (the 
contractor). Defense Logistics Agency (DLA), and the Project Manager (PM) were 
considered part of the team, but met with the core members on a bi-weekly or monthly 
basis depending on the need. 

Xwo of the interviewees identified themselves as the IPX lead. Eurther 
information provided from each party led us to believe that the IPX was actually led by an 
individual acting in a program manager role. Xhe other interviewee took the lead in the 
contractual execution, including preparation of pre and post negotiation memorandums, 
as well as the negotiation itself. 

Xhe Product Support Integrator (PSI) was difficult to identify. Xwo interviewees 
could not identify the PSI. Another interviewee stated that the entire IPX acted as the PSI 
and the last interviewee stated that the Navy had PMs for planes at different locations, but 
the Navy Supply Command (NAVSUP) was able to make decisions independent of them. 
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Question 2: How did your structure change as PBL was implemented (or did it)? 

The interviewees stated that change in the structure during implementation was 
minimal. The IPT did become smaller or “leaner” with the elapse of time. The PBL 
implementation IPTs were much larger in number in the beginning (to “kick-off’ the 
program), because they included all stakeholders. Once the PBL strategy and acquisition 
planning was finished, the core members took over the actual execution, effectively 
reducing the group to approximately twelve members. The interviewees all responded 
that the core version of the IPT was still intact but they meet less frequently as time goes 
by. 

During the follow-on interviews, the interviewees were asked who prepared the 
Business Case Analysis (BCA)? The responses varied, however, it was clear that the IPT 
did not prepare the BCA. One interviewee stated that a product and engineering group 
prepared the BCA with active participation from the IPT. Another interviewee stated that 
the BCA was executed by the Comptroller. Still another stated that the BCA was 
prepared by the Supply Chain Solutions group. In spite of the difference in responses as 
to who prepared the document, all interviewees indicated that the IPT members 
participated by providing information during preparation, and that they were aware of the 
BCA contents. When asked if the BCA addressed alternative strategies (other than the 
one selected) as PBL guides suggest, the interviewees stated that it did not. (One IPT 
member stated that the PBL guide was a “preachy document” that suggested PBL be 
considered, but didn’t explain the implementation process.) They stated that, in lieu of 
alternatives, the BCA only documented a comparison between the “status quo” and the 
selected strategy. 

The interviewees were asked if the IPT received any informal or formal PBL 
training. They were all aware that the Supply Chain Solutions Group (support staff 
office) offered a kick off session, however the information obtained during the interviews 
was inconclusive as to whether the F404 IPT had ever completed this session. Other 
responses offered were that personnel are more experienced in PBL techniques now 
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because they have been using them for several years, and that AT&L workforce 
certification requirements now include PBL training so additional training is no longer 
needed. 

Question 3: What organizational design elements had a positive or negative 
impact on PBL implementation? 

Two interviewees responded that the pre-existing IPX organization allowed the 
effort to progress at a faster pace because members already understood each other’s roles. 
One interviewee discussed specifically the mutual understanding of duties and limitations 
between procurement and logistics IPX members. During the follow-on interviews, these 
IPX members were asked if the Supply Chain Solution Group (responsible for kick-off 
training and perhaps some of the BCA preparation) had a positive or negative impact on 
implementation. Both members stated that they did not think Supply Chain Solutions had 
any effect on the success. 

Another interviewee stated that the support of the weapons manager was critical 
to successful implementation. He indicated that when weapons manager support was 
apparent, PBL implementation proceeded at a faster pace. 

Personnel resistance to the PBL concept had some negative impact at the 
beginning of the program. Two interviewees responded that the general lack of 
information about PBL was likely a source of fear amongst some of the IPX members. 
They continued on to say that initially there was concern about displacement, especially 
in the depot and within DLA. The concerns were that DLA parts would become 
Contractor Furnished Material (CFM) leaving the DLA logistics personnel with nothing 
to manage! The depot personnel were concerned that PBL would eliminate organic 
support (their jobs) at the depot. They both stated that the fear seemed to dissipate with 
time and that all members of the IPX seemed satisfied with the PBL arrangement once it 
was in place. 
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Question 4: If you could go back and change anything during the implementation 
phase, what would it be and why? 

Two interviewees responded that if they could change anything, they would have 
narrowed the focus more quickly. Specifically, they mentioned that at the beginning, the 
PBL strategy included DLA and they wished they had focused on NAVICP items only. 
In fact, the DLA portion was eliminated months later because that portion of the scope 
was prohibiting progress on the NAVICP portion. One of the interviewees stated that he 
believed follow-on PBL for the program would include DLA, but a narrow focus during 
start up was most effective. 

Another interviewee responded that during the start of the PBL contract, there 
was a “disconnect” when it became apparent that not all parties were working to the same 
Scope of Work. He stated that the problem was resolved quickly, but did cause some 
initial confusion. 

The last interviewee identified several elements factoring into the success of the 
PBL effort. They were: (1) a good working relationship within the IPT, and between the 
IPT and the contractor; (2) a willingness by the Navy and contractor to compromise 
during negotiations; and (3) an accurate calculation of demand for 36 components 
covered under the PBL (baseline data). During the follow-on interview, he also stated 
that another contributing factor was upper management support. This interviewee 
identified funding as a challenge to success but could not elaborate on specific funding 
issues. 

Question 5: What post-PBL implementation results have you seen or 
experienced? 

All interviewees identified results as a decrease in backorders (from over 800+ to 
nearly 0), an increase in component life, and monetary savings. Qne individual also 
added that work-in-progress and repair tum-around-times had been reduced. 

C. GAO REPORT 

GAO Report 05-966, DoD Needs to Demonstrate that Performance-Based 
Logistics Contracts are Achieving Expected Benefits, was published in September 2005. 
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The report stated that the Services were not conducting updates to BCAs and that savings 
as a result of PBL implementation could not be proven. All IPX members were asked if 
they were aware of the GAO report. All interviewees reported being aware of the report 
and its contents. They all responded that the Department of the Navy did not concur with 
the GAO’s findings but other responses were inconsistent. Some indicated that they 
(IPTs) do, in fact, provide updates to BCAs when required (e.g. changes in scope). The 
Radar Warning Receiver IPT was specifically asked if they had updated the BCA prior to 
award of the 5-year option period on the PBL contract. They responded that they did not, 
although they did review the document to make sure the numbers were still valid. They 
also added that they did not believe the GAO staff really understood the PBL concept and 
because of its complexity, it would be hard to relay a solid understanding to the GAO 
staff. One member from the F404 IPT stated that the BCAs were required only for 
budget purposes (to estimate future funding needs.) He added that there is no point in re¬ 
thinking the PBL strategy under a firm fixed price contract. Another F404 IPT member 
stated that he was not sure if the BCAs were updated because the Supply Chain Solutions 
office was responsible for that document. 

D, INTERVIEW RESULTS - SATS IPT 

Interview questions were sent to five IPT members on the Army’s SATS team. 
One member was at the middle management level, the other four were at the functional 
level. The SATS team is in the process of implementing PBL. Their responses are 
combined and provide a general consensus of how the IPT team is structured, how it 
operates, and their perceptions of PBL. 

Question I: How is your organization structured? 

The TACOM organization has utilized an IPT structure since 1997. The SATS 
IPT was formed in 2001, prior to the Milestone Decision Authority/Approval. The IPT 
consists of personnel from contracting, logistics, item management, engineering, quality 
assurance, pricing, legal counsel, policy, combat development, and the production 
contractor. The SATS is currently supported using the traditional Army supply system. 
The SATS was not identified as a PBL candidate when the initial production contract was 
awarded, but became a candidate in mid-2004. 
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Question 2: How do you feel about PBL? 

Most interviewees have only a limited knowledge of PBL. They feel that the 
Army guidanee is laeking and they are unsure how the SATS program, as it eurrently 
exists, would implement PBL. They do know that PBL was designed for applieation to 
Aequisition Category (ACAT) I and II Programs. Since the SATS is an ACAT III 
Program, they are not sure if PBL could or should be implemented. The Project Manager 
for the past two years was a proponent of PBL. Team members state that they are 
uncertain where the new leadership staff stands on this issue. 

Question 3: What significant changes has your organization experienced in the 
past five years, and how were they received? 

The major change mentioned was that operations are different since the start of 
the war. The priorities have shifted to a total soldier support mindset. Prior to the war on 
terrorism, people were focused more heavily on satisfying the requirements generators, 
even though they always knew the soldier was the ultimate customer. That focus has 
shifted to a more direct communication with the soldier in some instances. 

The restructure to a modularity concept has also increased the visibility of the 
Product Manager at TACQM Rock Island. This has resulted in continuous program 
reviews where tool sets and kits are being combined to accommodate the future force 
structure. 

Question 4: How do you feel about contracting for performance when the support 
strategy has traditionally been organic? 

Qne IPT member stated that if the strategy works, the SATS IPT should use it. 
Information received from other IPT members indicated that they were not familiar 
enough with the PBL concept to identify changes that implementation would cause and 
therefore they could provide no definitive response. 

E, APPLICATION TO THE ORGANIZATIONAL DESIGN FACTORS 

1. People 

All four PBL IPT organizations studied contain a diverse blend of individuals 
from different backgrounds with various levels of education and experience. The 
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individuals interviewed from the PBL teams were upper management, middle 
management, and functional program members. 

a. Familiarity with Teaming 

All of the PBL team members responded during the interviews that they were 
already familiar with the IPX environment (but not necessarily familiar with PBL), before 
being assigned to the PBL teams, so they had a better general understanding of the roles 
and duties of each member. They felt that this continuity in structure allowed them to 
work together as a cohesive unit, and progress at a faster pace. The IPX members felt 
that they had the authority to make decisions, as long as they were within the guidance 
issued by the Navy. 

b. Communication 

One team reported that one of the biggest challenges during 
implementation was communication and that many issues could have been avoided by 
making sure that all levels of management and necessary players were kept informed, and 
that the information provided was specific and timely. 

c. Reward Systems 

The interviewees provided information that indicated there were informal 
and formal reward systems in place. Formal awards were in the form of monetary 
compensation for team and/or individual performance. Concerning the informal reward 
system, several interviewees indicated that participation on the PBL team afforded 
promotion potential. 

d. Fear 

Nearly all of the IPX members reported that there was some initial fear 
and reluctance amongst the teams and stakeholders because the concept of PBL was new 
to them, and because they could be “contracting themselves out of a job.” The most 
noticeable example provided was by the APU team member, who stated that depot 
personnel balked when they realized that the PBL provider staff would assume some of 
their functions. The depot staff initially viewed the PBL effort as a threat to their 
existence, but later recognized that implementation of PBL would allow them to return to 
their core function of “turning wrenches.” The Defense Logistics Agency (DLA) was 

another example. They were afraid that if parts management became a contractor’s 

53 



responsibility, they would have nothing to manage. None of the IPX members reported 
that personnel displaeements aetually oeeurred as a result of PBL implementation, and 
two stated that implementation aetually turned out to be an effeetive method in dealing 
with redueed human resourees. Several interviewees stated that the personnel in the 
NAVICP organization have, in general, beeome more reeeptive to the PBL eoneept as 
their level of experienee has inereased and the guidanee has beeome more available. 

e. Upper Management Support 

IPX members from two teams reported that upper management support 
was strong and that it was a key element as the teams worked through the initial 
eonfusion and laek of enthusiasm. Other IPX members identified individual personalities 
of IPX members as having eontributed to sueeess, beeause the teams ineluded high-level 
members who were motivated, dedieated, eooperative, and strong-willed. 

f. Multiple Assignments 

Interviewees reported that assignments to the PBL implementation teams 
eame from upper management and that, in many eases the assignment was in addition to 
their existing duties. Xhey were expeeted to fulfill the assignments from both jobs 
simultaneously. One person who was assigned multiple tasks indieated that the PBL 
effort took preeedenee, eausing his other job duties to suffer. Xhe F/A-18 E/F team 
members reported that they also were assigned to the PBL effort in addition to existing 
duties and that they initially met off-site to minimize distraetions. 

2. Processes 

a. Training 

When asked about training, the IPX member’s responses indieated that 
training was minimal. Xhe RWS IPX members said they reeeived a short “kiekoff’ 
training session and possibly some other training when the team was formed. Xhey stated 
that it was eondueted by the Supply Chain Solutions Offiee. Xhe F/A-18 E/F team 
members indieated they had reeeived no training, and the information regarding training 
obtained from the F404 team was ineonelusive. Other individuals offered that personnel 
are more experieneed in PBF teehniques now beeause they have been using PBFs for 
several years and that most logistieians and program managers have eompleted the 
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AT&L workforce certification requirements, including two logistics classes that focus 
primarily on PBL. They state that additional training is no longer necessary. 

b. Loss of Productivity and Fear of the Unknown 

Each IPX team felt they experienced an initial loss of productivity while 
the team worked the “bugs” out. Since many of the team members were unfamiliar with 
PBL and were given little or no introductory training, the team spent valuable time 
figuring out the schematics of what they were suppose to be accomplishing. With that 
came the fears that they might be going down the wrong path. 

c. BCA Documentation 

One specific area in the PBL process that was discussed at great length 
was the preparation of BCAs. None of the IPX members that were interviewed reported 
that the BCAs were prepared by the IPX, although most indicated that they were aware of 
the BCA contents. Responses about who actually prepared the BCA varied between 
teams and included the Supply Chain Solutions Office, the Comptroller, a production and 
engineering support office, and a group called the “price fighters.” Responses about the 
contents of the BCAs were, however, consistent between teams. Interviewees were asked 
whether the BCA contained alternative strategies or documented that alternative 
strategies had been considered. They responded consistently that the BCA contained 
only the PBL strategy that was selected with a comparison to the “status quo.” If there 
was formal guidance issued by the Navy for preparation of BCAs, it was not mentioned 
by any interviewee. 

d. Assignment of IPT Leader and PSI 

IPX members were asked about the process of assigning an IPT leader or 
Product Support Integrator (PSI.) Many interviewees were unfamiliar with the term PSI. 
Several stated that they thought the Navy might use a different term for this function but 
none identified that term. No one mentioned an informal or formal process used for PSI 
assignment. One P/A-I8 E/L IPT member did identify the program manager as the PSI. 
The position of IPX leader was assumed by various team members. The lead was not 
assigned to the same functional category on each team. 
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3, Structure 

a. Cross Functional Teams 

Each of the four PBL programs operated under the same overall 
organization of NAVSUP, Naval Inventory Control Point. For the purpose of 
implementing PBL, all four of the organizations ehose to use an integrated team 
structure, where multiple funetions were represented. The IPTs consisted of larger 
numbers of personnel when they were initially formed, and then were reduced to a core 
group of about 10-12 people. Core members included logistics and contracting personnel 
for every team. Other IPX members from specialized functional areas were called to 
participate on an as-needed basis or to attend subject-specifie meetings. This oceurred 
naturally (unintentionally) in the proeess for two teams, and the teams were intentionally 
pared down for the other two programs. The IPX members stated that the core group was 
more productive and operated more efficiently than the larger group because there were 
less confheting priorities. The F/A-18 E/F IPX structure also ineluded an Executive 
Steering Committee made up of the highest-level team members responsible for traeking 
and ensuring progress as well as forming strategy. The team leaders were then 
responsible for action items and due dates assigned to sub teams. The IPX members who 
were interviewed stated that this aeeountability proved to be invaluable to the team’s 
suecess. Other than streamlining the initial IPTs, there were no other significant changes 
in the strueture of any of the teams/organizations over the implementation period. 

The IPTs were ereated solely for the PBL efforts, however, the team 
personnel were accustomed to operating in an IPX environment prior to being assigned 
on the PBL implementation teams because NAVICP had been using this structure for 
about 10 years. In many instances, the personnel had already been assigned to the 
weapon system team for the same system that was implementing PBL, thus the 
assignment to the PBL team seemed natural. Many IPX members retained their original 
job duties in addition to the duties related to the PBL effort. All of the IPX teams are still 
intact, at least at the core group level, years after the initial implementation. 
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b. Support Offices 

All of the IPTs used support offiees to some extent. Speeifieally 
mentioned was the Supply Chain Solutions Offiee. Although information varied from 
team to team, it is elear that this support offiee had a role in the preparation of the BCA, 
and some informal PBL training. Other staff support offiees mentioned in eonjunetion 
with BCA preparation were the Comptrollers Offiee, and the Produetion and Engineering 
Support Offiee. 

c. Assignment of PBL Team Leaders/PSIs 

The IPX leader role was not formally assigned and it was not assumed by 
the same funetion (i.e. eontraeting, logisties, program manager) on eaeh IPX. Several IPX 
members responded that they did not know who lead the IPX, although one interviewee 
indieated that the weapon manager support was eritieal to sueeessful implementation of 
PBL. That team member added that when weapon manager support was apparent, PBL 
implementation proeeeded at a faster paee. There was similar eonfusion about the PSI. 
Most IPX member responses indieated that they did not know who was assigned as the 
PSI, indieating there was no formal assignment. 

F. SUMMARY 

This ehapter deseribed the results of interviews of IPX members from four 
programs that have implemented PBL and the SATS program, whieh is in the proeess of 
implementation. The results were grouped first by program, and then by the 
organizational design faetors of people, proeesses, and strueture. The next ehapter will 
deseribe eonelusions and reeommendations for organizational design faetors having a 
bearing on sueeessful implementation of PBL. 
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V. SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 

A. INTRODUCTION 

The purpose of this study was to deseribe and analyze the organizational design 
faetors that may have benefited or hindered PBL implementation. This paper focused on 
the specific areas and design factors of people, processes, and structure. Using the 
information obtained from the interviews with PBL IPT members, the study identified 
additional organizational characteristics that appeared to have a direct impact on 
implementation of the four Navy PBL programs. Recommendations for implementation 
and application to the SALS Program have been generated based on those characteristics, 
and a template has been formed to facilitate the use of PBL. The review and analysis of 
the information collected is designed to advance the understanding of PBL and the effects 
of organizational design factors on the implementation of PBL. 

This chapter contains an analysis of the findings presented in chapter 4. This 
analysis uses the Organizational Systems Framework to identify design factors of the four 
Navy programs that have implemented successful PBL programs. By identifying and 
analyzing the design factors that contributed to the success of the PBL programs, we have 
been able to draw conclusions concerning certain design factors that had a direct impact 
on organizational performance. These conclusions will advance the understanding of 
organizational congruence and design. This chapter also includes recommendations and 
a template designed to facilitate PBL decision-making and application of PBL to the 
SALS Program and other potential TACOM programs. 

B, ANALYSIS OF FINDINGS AND CONCLUSIONS 

The people, processes, and organizational structures examined appeared to play a 
substantial role in the implementation process shifting each of four Navy organizations 
from a traditional transaction-based approach to a performance-based approach in the 
area of weapons system support. 
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1, People 

a. Familiarity with Teaming 

We found relatively consistent commonality in terms of the expectations 
and performance capabilities of the IPX members both among and between teams. All of 
the members on the four PBL IPTs had worked in an IPX environment prior to the PBL 
assignment. Xhey all indicated a basic understanding of each other’s roles and 
responsibilities and acknowledged the importance of integrating those roles to achieve 
common goals. Xhis familiarity with a team-based structure made the transition to a PBL 
team faster, easier and more comfortable for team members. Xhe continuity of the 
teaming environment gave PBL IPX members something familiar to rely on as they 
ventured down a relatively different assignment. (One individual commented that 
“persistent personalities” of team members had a significant impact on success.) 
XACOM-RI personnel are also familiar with cross-functional teams. Xhe organization 
has been using an IPX structure for approximately eight years. Continuing to use a cross¬ 
functional IPX for PBL implementation could facilitate a cohesive and stable team 
relationship. Conversely, using an alternate coordinating mechanism (other than a cross 
functional IPX) could cause additional confusion and time delays due to PBL participants 
having to learn new roles, establish new relationships, and develop adaptive working 
processes. 

b. Communication 

One team clearly indicated that communication was a challenge and that 
in some cases issues could have been avoided if more specific and timely information had 
been provided. Xhe biggest communication challenge seemed to exist outside of the 
team, i.e., managing external boundaries. When channeling information upward or 
outward, IPX members indicated facing relatively numerous obstacles and various forms 
of resistance. Although it was only specifically mentioned by one team, all teams 
generally acknowledged that effective communication would be a challenge, inherent 
with the introduction of a new business process and formation of a new team that could 
not be avoided. However, recognition of the challenge during the beginning of the 
program was critical to establishment of a proper and efficient knowledge sharing and 

communication path. Familiarity with teaming seemed to facilitate identification of key 
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stakeholders within and outside of the organization, ensuring that eommunieation paths 
would be more effeetive. Stressing focused and clear communications, the teams 
indicated they were able to avoid many internal issues that could have been disruptive. 

c. Reward Systems 

Information obtained during the interviews showed that the PBL IPTs had 
both formal and informal reward systems, however the interviewees appeared to place the 
informal rewards in a higher regard. Individuals seemed to possess a real dedication and 
desire to work toward successful implementation of the PBL program and established 
goals. The interviewees also indicated that they felt their promotion potential increased 
after working on a PBL implementation team. The team members used words like “felt 
appreciated” and “felt essential”, perhaps in part because they indicated they received 
continuous praise for their efforts. Monetary (formal) rewards were mentioned and were 
said to be sufficient. 

TACOM has not completed implementation of PBL into any program. 
We believe that some of the SALS team members (and other TACOM associates as well) 
are skeptical of upper management support, because implementation is being mandated 
instead of encouraged. Some officials demonstrate a lack of concern as to whether PBL 
is actually an appropriate strategy for implementation. For example, as stated in a 
previous chapter, PBL is mandated for ACAT I and II programs which are the more 
complex, higher dollar value programs. The SATS Program, and a high percentage of 
other TACOM-RI programs are ACAT III (higher in density, lower in dollar value and 
complexity) where PBL may not be appropriate, but still, some higher-level officials 
demand that TACOM-RI nominate candidates for PBL implementation. 

d. Fear 

All interviewees indicated that there was some level of fear amongst the 
IPT members and organization when the PBL implementation effort was assigned. The 
concept of PBL can have a negative connotation because of the potential for government 
jobs to be contracted to the private sector. Many team members and personnel from other 
areas of the organization felt threatened. That threat diminished as PBL was 
implemented and no actual displacements occurred. Of course, many duties were shifted. 
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which had the positive effeet of allowing team members to gain different types of 
experienee. Also, fear has slowly dissipated as personnel have beeome aeeustomed to 
this new business praetiee. 


The SATS IPX members did not indieate that fear of eontraeting out 
government jobs affeeted their team at all. Based on the information provided in 
response to the interview questions, it appeared that the SATS team might not fully 
understand the PBL eoneept and implieations of implementation. This will be explored 
further later in the ehapter as part of proeesses and training. 

e. Upper Management Support 

We largely attributed the level of dedieation and eommitment the IPTs 
showed toward establishing PBL goals to the tremendous amount of upper management 
support provided at NAVICP. The IPT members truly believed in the upper management 
support and did not seem at all skeptieal that PBL was simply a fad or another feather in 
someone’s eap! 

f. Multiple Assignments 

Assignments to PBL teams eame from upper management. When 
management deeided to assign skilled assoeiates to the PBL efforts, they forgot one 
thing; people were already engaged in pre-existing program issues. Sinee PBL was 
identified as a top priority, the existing programs reeeived less attention and some began 
to suffer. Although there is not enough information to determine whether multiple 
assignments were appropriate or not, the interviewees indieated that it was problematie. 
To avoid eonflieting priorities and added stress, leaders would need to earefully examine 
their expeetations to determine whether they are realistie, and plan aeeordingly. 
“People,” ineluding the aspeet of human burnout, are part of organizational design. 
When people are assigned new work, the extent to whieh there is a eoneomitant deerease 
in existing workload would appear to direetly impaet produetivity. When one of these 
parts is misaligned, the system will experienee ineffieieneies (Roberts, 2000). 
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2, Processes 

a. Training 

Interviewees indicated that some level of training was available within 
each of the organizations, although the training that was actually conducted was minimal 
and inconsistent from team to team. Other than the short “kickoff’ training that one team 
attended, many had little or no PBL training as an implementation team. Most of the 
logistics specialists have begun to work their way through the Acquisition, Technology 
and Logistics (AT&L) certification process that includes completion of two Defense 
Acquisition University (DAU) logistics courses that focus primarily on PBL, but this 
training is very broad and is completed individually. In addition, many IPX members 
interviewed are now so experienced after having worked PBL efforts for a number of 
years, they no longer acknowledge the lack of training as a problem. We saw a number 
of problems that could be traced back to inadequate training. 

b. Loss of Productivity and Fear of the Unknown 

Productivity was definitely lost as IPX members spent time struggling with 
the unknowns of the new PBL concept. Assignment to the PBL IPX was an unfamiliar 
and overwhelming responsibility for team members, especially those who were still 
required to perform pre-existing duties. “This ‘total immersion’ process creates a great 
deal of stress on new personnel whose goal often shifts from mastering the job to learning 
‘survival techniques.’” (Bruner, 1998) As with any new process, it is expected that 
people will fear what they do not know or understand. Informative and timely PBL 
training could alleviate the fear that employees might be contracting themselves out of a 
job. 

c. Business Case Analysis (BCA) Documentation 

IPX members seemed unfamiliar with BCA documentation. Although all 
IPX members said they were familiar with the contents of the BCA prepared for their 
program, the responses about who prepared the documents were inconsistent even among 
team members. We also found that their descriptions of BCA contents were inconsistent 
with DoD guidance. DoD guides state that BCAs should document all alternatives of 
PBL strategy. Without exception, the IPX members who were interviewed stated that 

BCAs prepared at NAVICP included only a comparison between a traditional support 
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strategy and the seleeted PBL strategy, and that the BCA was not used to help the team 
deeide on whieh strategy would be optimal. 

d. Assignment of IPT Leader and PSI 

There was no mention of a formal proeess for assigning an IPT Leader or 
a Produet Support Integrator. On eaeh of the four Navy programs, there was one or more 
team members that did not know who was assigned to lead the IPT or who was assigned 
as PSI. Many interviewees stated that they were unfamiliar with the term PSI, but even 
after they were provided a deseription of that role, they eould not identify a person 
oecupying the position. 

Proper training is essential, espeeially with the introduetion of a new 
business proeess as eomplex as PBL. These programs are eomplex, high visibility, high 
dollar, ACAT I and II Programs that demand the best available resources. In order to 
benefit from those resources (people), proper (meaningful and high quality) training must 
occur. 

Proper and timely training has many benefits. Given proper training, the 
teams would consistently know how to select or assign an IPT leader and a PSI. They 
would know who prepared the BCAs, what the BCAs were used for, what they contained, 
and when they should be updated. Another benefit of training is a broader understanding 
and knowledge of PBL. 

The SATS IPT members have not completed any PBL training as a team, 
which explains some of the confusion and fear they are experiencing as they seek to 
implement this new business process. They did, however, assign an IPT leader when the 
team was first established. None of the IPT members, including the leader, had any 
experience with PBL prior to the assignment. Training as a team would allow them to 
become familiar with terms, processes, and what to expect upon implementation. 

e. Guidance 

The findings in the September 2005 GAO report provided some 
interesting insight into the Navy’s implementation of PBL. DoD guidance provides a 
skeletal framework for implementing a PBL strategy; however, the Navy has established 

their own version. While the Navy guide may resemble DoD’s to a degree, there are 
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some subtle interpretation differenees. For example, the GAO report alleged that BCAs 
are not being updated as they should. Information obtained during the interview proeess 
indicated that the Navy uses their own PBL guidance that provides a different 
interpretation as to when updates are required. Establishing supplemental guidance 
within the Military Services is not unusual, but Services should ensure that it is consistent 
with DoD Directives and guidance. 

3, Structure 

a. Cross Functional Teams 

The IPX members of the four organizations studied worked in IPX 
environments prior to being assigned implementation of PBL. The IPTs were established 
to support weapons or aircraft systems. IPX members were therefore familiar with the 
teaming concept and also with the items/systems for their particular team. During initial 
formation, all stakeholders were included on the team. This included cross-functional 
members such as program managers, weapon system managers, contracting, logistics, 
quality, and engineering. It also included others with a vested interest such as the 
contractor, the depots, and customers or users. 

Shortly after the PBL IPTs were established, team members realized that 
the teams were too large to work effectively and restructured by transitioning from a 
large group to a smaller group. This was a streamlining effort designed to enhance 
productivity by empowering a smaller group of core members. The IPX members stated 
that the core group was more productive and operated more efficiently than the larger 
group because there were less conflicting priorities. One of the PBL teams used an 
Executive Steering Committee to track progress and assign accountability to sub-teams. 
The team members seemed entirely satisfled with the results, stating that the 
accountability proved invaluable. The PBL IPTs remained intact past the date of this 
document. 

We conclude that the use of an IPX structure for PBL implementation was 
a factor conducive to success, primarily because each team member was familiar with the 
concept and could operate efficiently and effectively immediately when the team was 
formed. If the programs were setup in a traditional functional or stovepipe structure - a 
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structure no longer familiar to many NAVICP personnel - eommunieation problems 
would have likely resulted in eonfusion, greater ineffieieneies, and untimely aetions. 

b. Support Offices 

IPX members mentioned a variety of support offiees that played an 
integral part in the PBL implementation proeess. For example, a group ealled the Supply 
Chain Solutions Offiee was one support offiee that eondueted training, prepared BCAs, 
and prepared or provided PBL implementation guidanee. We were unable to define the 
exaet mission of the Supply Chain Solutions Offiee with the information obtained during 
the interview proeess, however it was apparent that one of their main funetions was to 
prepare BCAs for any PBL IPX in NAVICP. For eaeh PBL effort, they were available to 
prepare, eoordinate, and staff the BCA, although not all of the IPXs used the Supply 
Chain Solutions Offiee for this task. One advantage to using a single offiee to prepare 
BCAs is that this alleviates the need to researeh the method and eontents required for a 
BCA eaeh time one needs to be proeessed. It also ensures a degree of eonsisteney in the 
final produet. A disadvantage to using a support offiee to prepare the BCA is that some 
team members did not appear to know speoifieally what the BCA eontained. One reason 
may be that the Supply Chain Solutions Offiee eoordinates at a higher level and not with 
the IPX. 

Aeeording to the interviews, the Supply Chain Solutions Offiee also 
provided some form of kiekoff training to some of the teams. As diseussed earlier in this 
ehapter, we see a real benefit to reeeiving proper and timely training. If the Supply Chain 
Solutions Offiee or another support offiee was assigned responsibility for providing PBL 
kiekoff training, they eould ensure that all pertinent proeess and proeedural information 
was eonsistent and was presented immediately after formation of the PBL IPX. 

c. Assignment of PBL Team Leaders 

Even though the strueture of the organization seems to fit the overall 
purpose, there are eritieal misalignments in some areas. Xhere is no formal assignment of 
IPX leaders. Additionally, when the IPX leader naturally emerged, they did not always 
represent the same funetion on the team. For example, the weapon system manager did 
not always emerge as the team leader. Xhis is a struetural mistake beeause it eauses 


66 



internal confusion when IPX members do not know who their assigned PBL IPX leader 
is. Even though functional team members are aware of each other’s responsibilities and 
duties, a formal IPX leader should always be clearly identified. 

Xhe SAXS IPX immediately identified an IPX leader when the team was 
formed. Xhe IPX leader has been instrumental in guiding the team through the beginning 
steps of an unfamiliar process. 

d. Assignment of PSI 

A similar problem exists with the PSI. Xhe PSI plays a key role in the 
agreement between major stakeholders, and especially the Program Manager. He has an 
important role in integrating the PBL effort and is the single point of accountability that 
makes sure industry and the government work together to meet performance objectives. 
Xhe PSI can be a government or private industry representative. Even though the PSI 
role carries the utmost responsibility, most of the team members interviewed were not 
familiar with the term PSI. Xhey may have used a different name for the function, but 
even after being given a definition of the PSI function, they were unable to identify who 
was assigned this role. Xhis is another area where a formal assignment would ensure that 
all team members were aware of who the person was and what function they performed. 

C. RECOMMENDATIONS AND APPLICATION FOR THE SATS AND 

OTHER TACOM-RI PROGRAMS 

Identifying and developing lessons learned is an important step in implementing 
change. Xhe scope of this study was to identify organizational design factors that may 
have contributed to effective and ineffective levels of performance. A comprehensive 
analysis of the data collected provides this information. 

1, Current Status of SATS 

Xhe SAXS Program was identified as a PBL candidate well over a year ago (mid 
2004). PEO guidance was issued at that time and provided a 13-step process for 
implementing PBL. Xhe intent of the PEO guidance is to complement DoD’s guidance. 
Xhe PEO guidance consists of similar steps (but not identical and not necessarily in the 
same order) as the DoD guidance outlined in Chapter II. Xhe SAXS Program is currently 
at Step 5, which involves base lining the system. Xhe SAXS IPX is struggling through the 

base-lining step because it is a new system and historical information that would be used 
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for a baseline is not available. Thus far, the results of this step have been ineonelusive in 
determining whether the SATS Program should eease or move forward with PBL. 

2, Careful Consideration for ACAT III Programs 

Based on the extensive effort, resourees, and “total immersion” that have taken 
place attempting to make PBL a good fit for the SATS system, we recommend that all 
future ACAT III programs be more carefully scrutinized prior to commencing the initial 
steps of implementation procedures. DoD mandates consideration of PBL for ACAT I 
and II systems. When initial direction to implement PBL was provided to the SATS 
team, concerns were raised about its applicability to this ACAT III Program. SATS is 
not categorized as an ACAT I or II system because it is not considered to be a highly 
complex system (it consists of commercially available automotive tools), it is not high 
visibility/high dollar (total unit price is less than $250,000), and it has a high density in 
the field (current POM quantity is approximately 6000). Although SATS is a mission 
critical system used to provide maintenance support for Army combat and tactical 
equipment on the battlefield, it does not directly affect combat readiness. In addition to 
the fact it is an ACAT III system, there is no maintenance program to capture reliability 
data, there is no depot repair program in existence, and sustainment costs are low. These 
are a few of the criteria that should be considered before ACAT III programs are 
nominated as PBL candidates. Input from subject matter experts should be carefully 
considered because they possess an intimate knowledge of their system(s). 

3, People 

a. Use Highly Skilled IPTs 

IPT interviewees reported that personalities of individual team members 
played an important part in implementation progress. Specifically, they mentioned 
strength and persistence. 

We recommend that prior to the formation of a PBL IPT, an analysis of 
the organization and potential team members be completed. The goal of this analysis 
should be to gather enough information in order to choose a team consisting of highly 
skilled leadership and specialists who possess the necessary knowledge, skills, and 
abilities to form a congruent relationship and carry out the mission successfully. Team 
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member seleetion should not be based on availability. Instead, they should be “hand 
pieked” in order to give the program the best ehanee for sueeess. We reeommend that the 
analysis above be eompleted for the SATS team (already seleeted) and if skill gaps are 
identified, alternate members should be seleeted. 

b. Establish Roadmaps for Communication 

All IPTs studied agreed that eommunieation was a ehallenge that eould 
not be avoided. 

We reeommend for SATS and other TACOM-RI programs, that 
eommunieation paths and ehains be established and agreed upon by the initial IPX, and 
that those paths be formally doeumented. The formal doeumentation should identify key 
stakeholders as well as information flow. This will ensure that the entire team 
understands how and what information will be provided. It also provides a roadmap that 
ean be used for eonfliet resolution. 

c. Identify Reward Systems 

The interviewees from the IPTs studied were sueeessful using both 
informal and formal reward systems, although they seemed to favor the informal reward 
system. We attributed that, in part, to the tremendous upper management support. 

We are eoneemed that the deseribed type of upper management support at 
NAVICP does not exist at TACOM. We reeommend that TACOM leaders beeome more 
knowledgeable about PBL so that they ean sineerely demonstrate their support of this 
new eoneept. Sineere demonstration requires that leaders reeognize that PBL may not be 
appropriate for all programs and eannot be applied aeross the board. Thus, they must be 
ready to aeeept (with a proper analysis) an IPX’s determination that their program is not a 
good PBL eandidate. One method to inerease leader’s PBL savvy is to ereate short 
modules for knowledge enhaneement. We suggest a support offiee, sueh as the strategie 
planning team, provide these modules. 

We reeommend that upper level managers further demonstrate their 
support of PBL by informing the IPTs during formation of any potential formal or 
informal awards that may be available upon sueeessful implementation. Additionally, 
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upper level managers must publiely aeknowledge that the IPX has an important and 
highly visible task to perform. These actions will create team buy-in to the PBL effort. 

d. Remove/Prioritize Conflicting Impediments 

Upper managers assigned personnel to PBL IPTs. In most cases, these 
personnel were also required to perform pre-existing duties, as well as new duties related 
to the PBL effort. Conflicting priorities caused confusion and stress, as well as 
degradation in performance on pre-existing duties. 

Some of the SALS IPX members are also members of other IPXs. 
Conflicting priorities may have delayed implementation progress. We recommend that 
upper managers clearly identify the priority of the PBL effort during team formation and 
ask the team to identify other tasks that may impact their work on the program. 
Managers should be responsible for removing any roadblocks to progress or success. 

4, Processes 

a. Provide Consistent Training and Guidance 

Interviewees indicated that some level of training was available within 
each of the organizations, although the training that was actually conducted was minimal 
and inconsistent from team to team. The numerous problems associated with lack of 
training were explained earlier in this chapter. 

We recommend that XACOM task a support office with development of a 
PBL “kick off’ training and that it be conducted for every XACOM-RI IPX seeking to 
implement PBL. The training should give an overview of the PBL concept and 
explanation of the implementation process. A portion of the overview and explanation 
should be devoted to potential implications (negative and positive) of the application and 
real life examples. Finally, the support office should provide a listing and location of 
available guidance. The timely and consistent application of a kick off training session 
would help to reduce initial fear (of the unknown) and negativity, familiarize the IPX 
with PBL terms and procedures, and provide them with the references they will need to 
guide them. Although the SAXS team is past the initial IPX formation and is further 
along in the process, we recommend that this IPX be given PBL team training to facilitate 
completion of the process and confirm that they are headed in the right direction. 
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5, Structure 

a. Use IPTs 

The successful PBL programs studied all used an IPX structure with 
representation from various functions. This structure was optimal because personnel 
were already familiar with it. They understood how an IPT worked and the roles and 
responsibilities of team members. The initial membership of the IPTs was large because 
it included all stakeholders. Sometime shortly after formation, the IPT was reduced to a 
core group, usually 10-12 people. 

We recommend that TACOM programs considering PBL be structured as 
Integrated Product Teams with representation from any applicable function. The 
TACOM organization has been using an IPT structure for at least 8 years, thus TACOM 
personnel are already familiar with the teaming concept and the roles and responsibilities 
of IPT members. The SATS program is already organized as an IPT. 

We also recommend that all stakeholders be part of the IPT that is initially 
formed, but that sometime during the first six months the IPT be reduced to a core group, 
or that a sub-IPX of core group members be formed. This core group should consist of 
10-12 people that are involved in the daily execution activities. The larger (or complete) 
IPT should continue to meet periodically to monitor progress and have input to strategic 
decisions. The larger IPT may want to consider appointing an Executive Steering 
Committee to do this, as it would reduce the number of meetings required for the larger 
group. The SATS team has naturally reduced itself to a core group for daily execution 
activities. 

b. Use Support Offices 

The IPTs that were studied used support offices to provide training and to 
prepare BCAs. There were advantages and disadvantages associated with this. One 
advantage was the gain in efficiency because the personnel preparing the documents were 
already familiar with content and format requirements. Another advantage was that the 
BCAs and training were consistent in format and content for all programs. A significant 
disadvantage was that because they were not involved in the preparation, the IPT 
members disassociated themselves from it and were not always aware of BCA contents. 
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We recommend that TACOM use a support office for BCA preparation, 
and that those personnel involved in the BCA preparation be temporarily matrixed to the 
IPX. This structure allows the gain in efficiency, at the same time ensuring that team 
members are still connected to the document and information it contains. The TACOM- 
RI organization already includes a Strategic Planning Team, and we suggest that team be 
an option for this assignment. 

c. Formal Assignment of PBLIPT Leaders 

The PBL IPTs that were studied did not have a formal assignment process 
for IPT leader. We believe this caused some internal confusion within the team. 

The SATS team did assign an IPT leader when the team was formed and 
all members are aware of who took this role. For other TACOM-RI IPTs, we 
recommend that an IPT leader be assigned at formation, and that the assignment be 
documented. The assignment documentation should be updated if the leader changes. 
This formal assignment not only establishes a historical record for administrative 
purposes, but also ensures that all team members recognized the person in a leadership 
position. 

d. Formal Assignment of the PSI 

The PBL IPTs that were studied did not have a formal assignment process 
for the Product Support Integrator. The PSI is a very important position with the 
responsibility for integrating the PBL effort. Most of the team members were not 
familiar with the term PSI, and did not know who was assigned this role. 

The SATS team has not progressed far enough in the implementation 
process for PSI assignment. For SATS and other TACOM-RI IPTs, we recommend that 
a PSI be assigned formally (in writing) at the proper time in the implementation process. 
The assignment documentation should be updated if personnel changes affect the 
assignment. This formal assignment not only establishes a historical record for 
administrative purposes, but also ensures that all team members recognized the person 
responsible for integration so that they can report progress and significant issues. 
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D, TEMPLATE FOR PEL DECISION MAKING/IMPLEMENTATION 

All of the recommendations contained in this chapter have been incorporated into 
a template shown as the Appendix. The template is designed to facilitate PBL decision¬ 
making and application of PBL to the SATS Program and other potential TACOM 
programs. The template will be provided to TACOM-RI leaders and recommended for 
use across the organization. 

E, AREAS FOR FURTHER RESEARCH 

Due to the complex and dynamic nature of PBL, limitations had to be placed on 
the depth of research we could realistically perform. Many topics were mentioned in the 
interviews that deserved further investigation. We did not pursue those topics; however, 
they are presented below as areas for further research. 

1. Develop a Measurement Method 

A measurement method that fits the PBL system is recommended. PBL reliability 
and availability metrics were mentioned. The results experienced from the APU PBL 
team show that reliability may not be the best measurement for that system because 
reliability is difficult to assess. Further research is required to address the types of 
weapons systems or organizational factors that should or should not measure reliability as 
a performance assessment. 

2. Building the Business Base 

Involving Foreign Military Sales (FMS) customers in the implementation stages 
of PBL was seen as a positive way of increasing the business base for one of the systems. 
However, this was not pursued in the early stages of the PBL effort and resulted in 
delayed benefits. There may be situations where this should not be standard business 
practice. This area warrants further analysis and investigation to identify such potential 
areas. 

3. Analyze Navy PBL Guidance 

Comparison of the DoD guidance to the Navy’s PBL guidance would provide 
insight. The GAO findings brought an interesting feature to the research results. As with 
any high visibility, high dollar value weapon system, political involvement is Itkely. One 
interviewee indicated that the GAO was unfamiliar with the complexity of the PBL effort 
and the findings may have been politically driven. GAO’s allegations that BCAs were 

73 



not being properly updated at eritieal deeision points may or may not be aeeurate. 
Further investigation into the Navy’s PBL guidanee and eomparison to DoD guidanee 
eould provide helpful insight about the GAO report and eould open possibilities as to 
why politieal powers would intervene. 

4. Title 10 (X) Impact 

Do Title 10 requirements unneeessarily restriet or delay PBL strategies? More 
than one interviewee mentioned that Title 10 requirements (eore workload) had an impaet 
on their PBL strategy. Further researeh into Title 10 requirements should be eondueted 
to determine whether Title 10 and PBL strategies are ineompatible and legislative ehange 
is neeessary. 

5, Applicability to ACAT III Programs 

This research focused on the organization design characteristics of people, 
processes, and structure, and the impact those characteristics have on successful 
implementation of PBL. The study did not address the impact that particular program 
characteristics might have on successful implementation. One area that the authors 
believe should be further researched is whether ACAT III Programs and Systems should 
be considered as PBL candidates at all, and if so, in what situations? PBL is mandated 
for ACAT I and II systems because it is designed to work on systems that are high in 
levels of complexity, visibility, and dollar. The authors believe that applicability to 
ACAT III systems may be limited or non-existent. 

F. CLOSING 

The Navy PBL teams have done an outstanding job in their efforts to implement 
PBL. They quickly grasped the concept of PBL, applied expert direction, and took the 
necessary measures to make it work. We would like to acknowledge in particular the 
Navy IPT members for their time and cooperation during the interview process. 

The Organizational Systems Framework was used to analyze the information 
obtained during semi-structured interviews with the Navy IPT members to identify 
design factors of four Navy programs that have implemented a successful PBL program. 
By identifying and analyzing the design factors that contributed to the success of the PBL 
programs, we have been able to draw conclusions concerning certain design factors that 
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had a direct impact on organizational performance. These conclusions will advance the 
understanding of organizational congruence and design. 
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APPENDIX. TEMPLATE FOR PEL 


People: Consider highly skilled candidates 

Skill Levels 

High 

Medium 

Low 

- Edueation 

preferred 



- Experienee 

preferred 



- Dedieation 

preferred 



- Communieation 

preferred 



Communieations 

Defined 

Doeumented 


- Communieation Paths/Flow 




- Types of Communieations 




Reward Systems 

Defined 

Undefined 


- Formal 

preferred 



- Informal 

preferred 



Upper Management 

Yes 

No 


- Knowledgeable? 

preferred 



- Reeeived Training? 

preferred 



- Openly Demonstrates Support 

preferred 



Remove/Prioritize Conflieting Impediments 

High 

Medium 

Low/None 

- Pre-existing Duties 



preferred 

- PEL Priority 

preferred 



- Impaet to PEL 



preferred 

- Roadbloeks 



preferred 


*Communication should be defined and documented 


Processes: Consider information resonrces 

Training and Guidance 

Yes 

No 

Unknown 

- Support Offices Established? 

preferred 



- Kickoff/Followup Training 

preferred 



- Potential Implications 

preferred 



- PEL Terms & Procedures 

preferred 



- References Available 

preferred 




Structure: Consider team functions 





Yes 

No 

Unknown 

- Use of IPTs 

preferred 



- Use of Support Offices 

preferred 



- Formal Assignment of IPT Leader 

- Fornial Assignment of PSI 

preferred 



preferred 
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Template Narrative 


This checklist can be used as a tool to help identify the organizational designs that might lead to 
successful implementation of a PBL effort. 


1. People: 


Use Highly Skilled IPTs: Organizations implementing PBL should 
consider assigning people with high skill levels and high communication 
skills. Team members to consider are those with advanced levels of 
education, high degrees of experience, excellent communication skills, 
and those who display a dedicated attitude and keen desire to excel. Prior 
to selection, conduct analysis of organization and candidates in order to 
gather enough data to select the most highly skilled individuals. 

Establish Roadmaps for Communication: Communications are a 

challenge. IPT should establish and formally document communication 
paths and chains, as well as the type of information that should be shared. 

Identify Reward Systems: People/organizations benefit from well-defined 
awards systems. Upper management support and team buy-in are key 
design elements that directly impact results, outputs, and outcomes. Are 
upper level managers knowledgeable about PBL? Have they received 
training? Do they openly demonstrate support of the concept and IPT? 

Remove/Prioritize Conflicting Impediments: Careful identification and 
consideration of pre-existing duties is necessary in order to prioritize the 
PBL effort. Stresses from pre-existing duties can negatively impact the 
motives of team players. Upper level managers should identify and make 
public the priority of the PBL implementation effort. Potential roadblocks 
should be identified early and minimized or eliminated. 

2. Processes: 


Provide Consistent Training and Guidance. Support offices with clear 
direction regarding training should be employed. Formal and 
comprehensive kickoff training and follow-up training, including an 
overview of the PBL concept, explanations of the implementation process, 
PBL terms, and implications of the application, should be carefully 
planned and executed by the support office. Useful references should be 
made readily available. 


3. Structure: 


Use IPTs: IPTs consisting of all stakeholders and functional 

representatives should be formed. The members should have prior 
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experience working on IPTs. Team member roles and responsibilities 
should be clearly defined. Sometime during the first six months, the IPX 
should identify a smaller core group of 10-12 individuals involved in daily 
execution. This core group should be in constant communication. The 
larger IPX should meet on a periodic, but less often, basis to monitor 
progress and have input to strategic decisions. The IPX may consider 
appointing an Executive Steering Committee to do this. 

Use Support Offices: Establish one support office to provide all PBE 
training. Support office is responsible for BCA preparation but should 
matrix support to the IPX during this process to ensure team input. 

Eormal Assignment of PBE IPX Eeaders: Assign IPX leader during IPX 
formation. Document the assignment and update if necessary. 

Eormal Assignment of PSI: Assign PSI at the proper step during 
implementation process. Document the assignment and update if 
necessary. 
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